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Hands-On  Performance 


Combat  Readiness 


Job  Congruence 


The  Army  faces  a potential  problem  in  the  maintenance  of  trained 
skills,  particularly  in  the  Combat  Arms.  In  peacetime,  the  soldier's 
assignments  may  result  in  day-to-day  activities  which  are,  to  varyina 
degrees,  different  from  the  tasks  he  might  be  responsible  for  in  a 
combat  situation.  This  discrepancy  between  what  tasks  the  combat 
soldier  is  responsible  for  and  what  he  actually  does  as  part  of  his 
peacetime  duty  assignment  could  possibly  reduce  his  effectiveness  when 
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Given  this  situation,  it  would  appear  likely  that  soldiers  whose 
on-the-job  behaviors  (tasks)  approximate  the  behavior  (tasks)  they  will 
be  called  upon  to  perform  in  combat  would  be  more  likely  to  demon- 
strate proficiency  than  their  counterparts  whose  job  activities  were 
far  removed  from  their  projected  combat  roles.  A two-phase  exploratory 
study  of  this  phenomenon  and  of  its  consequences  for  individual  train- 
ing and  evaluation  was  conducted.  The  major  findings  of  the  first 
phase  were  that  the  performance  of  some  soldiers  (primarily  those  in 
the  HE  driver  and  loader  positions)  was  predictable  given  knowledge 
of  their  particular  background  and  job  experience.  Also,  predictions 
were  possible  in  many  cases  given  information  between  an  individual's 
day-to-day  activities  and  his  projected  combat  tasks.  However,  these 
findings  were  unsystematic i the  kinds  of  predictors  that  were  operat- 
ing and  the  strength  of  their  relationships  varied  for  different  11E 
crew  positions  and  for  different  tasks  within  each  crew  position. 
Therefore,  a second  phase  of  research  concerned  with  unraveling  these 
complexities  was  required. 

During  the  first  phase,  personal.  Army,  and  job  background  infor- 
mation was  obtained  from  approximately  200  11E  crewmen.  Also  collected 
was  information  about  the  congruence  between  an  individual's  day-to- 
day  activities  and  the  combat  activities  associated  with  the  crew  posi- 
tion in  which  he  was  to  be  tested.  All  troops  were  then  given  a 
series  of  hands-on  performance  tests. 

During  both  phases  of  this  study,  the  obtained  data  were  case 
into  several  types  of  analyses  in  which  background  and  task  congruence 
variables  were  examined  as  predictors  of  four  kinds  of  performance 
measures:  scores  from  the  hands-on  performance  test,  scores  from  a 
readministration  of  that  test,  SQT  scores,  and  confidence  estimates 
obtained  from  the  soldiers  regarding  their  ability  to  perform  tasks 
included  in  the  performance  test.  Four  separate  sets  of  analyses  were 
carried  out,  one  for  each  crew  position.  Additional  analyses  were 
performed  to  examine  the  relationships  amonq  the  performance  measures, 
as  well  as  to  evaluate  a task  taxonomy  for  its  usefulness  and  method 
fb^  organizing  the  obtained  results. 

‘^The  major  finding  of  this  study  is  that  different  aspects  of 
performance  (as  measured  by  confidence  estimates,  hands-on  performance 
tests,  and  SQT  scores)  could  be  predicted  to  a limited  degree  from  a 
relatively  small  number  of  variables.  These  variables  primarily 
reflect  a soldier's  specific  experience  in  his  crew  position.  However, 
significant  predictions  could  only  be  made  for  individual  tasks;  pre- 
dictions varied  for  different  tasks  in  any  given  craw  position.  Thus, 
the  relationship  between  a soldier's  day-to-day  activities  and  his 
performance  on  projected  combat  tasks,  while  somewhat  more  systematic 
than  previously  found,  is  still  complex  and  is  task-  and  soldier- 
specific.  ^ 
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EXECUTIVE  BRIEF 


Requirement 

The  Army  faces  a potential  problem  in  the  maintenance  of 
trained  skills,  particularly  in  the  Combat  Arms.  Training  pro- 
grams are  designed  to  establish  proficiency  in  a particular 
MOS,  using  as  a basis  the  tasks  which  will  be  required  of  a 
soldier  in  a combat  environment . Yet,  in  peacetime,  the  soldier's 
assignments  may  result  in  day-to-day  activities  which  are,  to 
varying  degrees,  different  from  the  tasks  he  might  be  respon- 
sible for  in  a combat  situation.  This  discrepancy  between  what 
tasks  the  combat  soldier  is  responsible  for  and  what  he  actually 
does  as  part  of  his  peacetime  duty  assignment  could  possibly 
reduce  his  effectiveness  when  required  to  perform  combat- 
related  tasks. 

Given  this  situation,  it  would  appear  likely  that  soldiers 
whose  on-the-job  behaviors  (tasks)  approximate  the  behavior 
(tasks)  they  will  be  called  upon  to  perform  in  combat  would  be 
more  likely  to  demonstrate  proficiency  than  their  counterparts 
whose  job  activities  were  far  removed  from  their  projected 
combat  roles.  The  Army  initiated  a two-phase  exploratory  study 
of  this  phenomenon  and  of  its  consequences  for  individual 
training  and  evaluation  in  May  of  1977.  The  major  findings  of 
the  first  phase  were  that  the  performance  of  some  soldiers 
(primarily  those  in  the  HE  driver  and  loader  positions)  was 
predictable  given  knowledge  of  their  particular  background  and 
job  experience.  Also,  predictions  were  possible  in  many  cases 
given  information  between  an  individual's  day-to-day  activities 
and  his  projected  combat  tasks.  However,  these  findings  were 
unsystematic:  the  kinds  of  predictors  that  were  operating  and 
the  strength  of  their  relationships  varied  for  different  HE 
crew  positions  and  for  different  tasks  within  each  crew  posi- 
tion. Therefore,  a second  phase  of  research  concerned  with 
unraveling  these  complexities  was  required, 
li 

Procedure 

During  the  first  phase,  personal,  Army,  and  job  background 
information  was  obtained  from  approximately  200  HE  crewmen. 

, . Also  collected  was  information  about  the  congruence  between  an 

individual's  day-to-day  activities  and  the  combat  activities 
associated  with  the  crew  position  in  which  he  was  to  be  tested. 
All  troops  were  then  given  a series  of  hands-on  performance 
tests. 

During  both  phases  of  this  study,  the  obtained  data  were 
cast  into  several  types  of  analyses  in  which  background  and 
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task  congruence  variables  were  examined  as  predictors  of  four 
kinds  of  performance  measures:  scores  from  the  hands-on  perfor- 
mance test,  scores  from  a readministration  of  that  test,  SQT 
scores,  and  confidence  estimates  obtained  from  the  soldiers 
regarding  their  ability  to  perform  tasks  included  in  the  per- 
formance test.  Four  separate  sets  of  analyses  were  carried  out, 
one  for  each  crew  position.  Additional  analyses  were  performed 
to  examine  the  relationships  among  the  performance  measures,  as 
well  as  to  evaluate  a task  taxonomy  for  its  usefulness  as  a 
method  for  organizing  the  obtained  results. 

Findings 

The  major  finding  of  this  study  is  that  different  aspects 
of  performance  (as  measured  by  confidence  estimates,  hands-on 
performance  tests,  and  SQT  scores)  could  be  predicted  to  a 
limited  degree  from  a relatively  small  number  of  variables. 

These  variables  primarily  reflect  a soldier's  specific  exper- 
ience in  his  crew  position.  However,  significant  predictions 
could  only  be  made  for  individual  tasks;  predictions  varied 
for  different  tasks  in  any  given  crew  position.  Thus,  the 
relationship  between  a soldier's  day-to-day  activities  and  his 
performance  on  projected  combat  tasks,  while  somewhat  more 
systematic  than  previously  found,  is  still  complex  and  is  task- 
and  soldier-specific. 

Utilization  of  Findings 

Troops  assigned  to  duty  positions  that  are  not  directly 
related  to  their  presumed  combat  roles  can  be  expected  to 
show  decrements  in  the  performance  of  combat  related  tasks. 

While  reassigment  of  these  soldiers  may  not  be  practicable, 
attention  must  be  given  to  upgrading  and  maintaining  their 
combat  skills  through  more  frequent  hands-on  practice  and 
♦..•■trough  the  use  of  aids  such  as  Soldier's  Manuals. 
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INTRODUCTION 


Personnel  whose  job  specialties  lie  within  the  Combat 
Arms  typically  receive  extensive  training  for  a specific  com- 
bat role,  and  are  periodically  required  to  demonstrate  their 
continued  mastery  of  combat  skills.  For  example,  tank  crews 
in  the  U.S.  Army  are  required  to  qualify  annually  in  gunnery 
by  adequately  performing  a series  of  live-fire  engagements 
(Table  VIII).  Likewise,  individual  crewmen  are  required  to 
demonstrate  their  continued  proficiency  by  taking  written  and 
hands-on  skill  qualification  tests  (SQTs).  These  demonstra- 
tions of  combat  readiness  are  required  regardless  of  each  crew 
member's  peacetime  job  assignments;  a criterion  level  of  pro- 
ficiency is  demanded  whether  or  not  the  day-to-day  activities 
that  constitute  the  soldier's  normal  job  approximate  the  tasks 
he  may  be  called  upon  to  perform  in  a combat  role. 

In  many  instances,  discrepancies  exist  between  a soldier's 
day-to-day  activities  and  the  kinds  of  tasks  for  which  he  must 
be  prepared  in  a combat  environment.  Such  discrepancies  may 
arise  for  several  reasons.  For  example,  the  high  costs  asso- 
ciated with  constant  exercising  of  troops  in  their  combat  roles 
may  preclude  such  practice  as  a full-time  activity.  Similarly, 
during  peacetime  there  are  many  rather  routine  but  nevertheless 
essential  tasks  which  must  be  performed  to  ensure  a garrison's 
smooth  operation;  such  assignments  are  often  given  to  combat 
troops.  These  discrepancies,  between  what  tasks  the  combat 
soldier  is  responsible  for  and  what  he  actually  does  as  part 
of  his  peacetime  duty  assignment,  could  possibly  reduce  his 
effectiveness  when  required  to  perform  combat-related  tasks. 

Given  this  situation,  it  would  appear  likely  that  soldiers 
whose  on-the-job  activities  approximate  the  activities  they 
will  be  called  upon  to  perform  in  combat  would  be  more  likely 
to  demonstrate  high  levels  of  proficiency  than  their  counter- 
parts whose  job  activities  were  far  removed  from  their  projec- 
ted combat  roles.  Were  such  a hypothesis  confirmed,  procedures 
would  need  to  be  developed  for  enhancing  and  maintaining  the 
combat-task  skill  levels  of  those  soldiers  who  are  primarily 
engaged  in  non-combat-related  tasks  during  peacetime. 

The  Performance-Based  Training  Work  Unit  of  USARIBSS' 
Individual  Training  and  Skill  Evaluation  Technical  Area  has 
supported  an  exploratory  investigation  to  answer  a limited 
set  of  questions  rolated  to  the  hypothesis.*  The  first  phase 

Rose,  A.  M.,  and  Wheaton,  G.  R.  Performance  effectiveness  in 
combat  job  specialties.  (AIR  6/78-66200-FR) . Washington , 

D.C. : American  Institutes  for  Research,  June  1978. 
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of  the  study  compared  the  combat-related  performance  of 
soldiers  whose  peacetime  duty  assignments  approximated  their 
required  activities  in  combat  with  the  performance  of  soldiers 

(whose  peacetime  activities  diverged  from  their  combat-projected 
tasks.  By  intent  and  design  the  first  phase  of  the  investi- 
gation was  limited  in  scope:  its  major  purposes  were  to 

I explore  that  a problem  existed  and  to  try  out  data  collection 

and  analysis  methods.  These  limited  goals  were  achieved, 
and  several  additional  potentially  important  research  issues 
were  uncovered.  The  exploration  of  these  issues  constitutes 
the  second  phase  of  the  study. 

This  report  will  first  review  the  recently  completed 
effort.  The  review  will  briefly  present  the  data  collection 
methodology,  the  analyses  previously  conducted,  and  results 
obtained.  Following  this  review,  we  will  present  and  discuss 
the  additional  research  issues  which  form  the  focus  of  the 
second  phase  of  the  research. 

The  remainder  of  the  report  is  divided  into  four  sections. 
The  first  of  these,  "The  Data  Set  and  Preliminary  Analyses", 
describes  the  initial  activities  of  this  phase  of  the  research 
and  presents  the  updated  and  additional  information  that  was 
incorporated  into  the  data  base.  Following  this,  the  second 
section,  "Congruence  Effects",  presents  and  discusses  the 
series  of  analyses  undertaken  to  explore  the  basic  congruence- 
performance  issue.  This  is  followed  by  a section  entitled 
"An  Alternative  Task  Taxonomy" , which  is  concerned  with  the 
development  and  evaluation  of  a speculative  method  for  organiz- 
ing the  obtained  results  so  as  to  increase  the  generalizability 
of  the  findings  to  other  MOS  categories.  The  final  section 
is  a brief  summary  of  the  findings  and  a discussion  of  their 
implications  for  the  Army. 

17 

L 

o 

i 

3 


SYNOPSIS  OF  THE  FIRST  PHASE  OF  THE 
PERFORMANCE  EFFECTIVENESS  STUDY 


Approach 

The  first  activity  in  the  initial  phase  of  the  effort 
was  to  select  a Combat  Arms  MOS  within  which  to  examine 
empirically  the  job-discrepancy /performance-effectiveness 
issue.  Conceptual  development  and  elaboration  of  the  measure- 
ment concepts  and  variables  was  the  objective  of  the  second 
task.  Development  of  a variety  of  data  collection  instruments 
constituted  the  third  task.  Included  among  these  instruments 
were:  (1)  task  checklists  for  use  in  developing  measures  of 

a class  of  practice  variables,  namely,  measures  of  frequency 
and  recency  of  task  performance;  and  (2)  questionnaires 
designed  to  tap  into  variables  presumably  reflecting  job 
congruency  as  well  as  other  background  information  potentially 
predictive  of  performance.  The  fourth  major  activity  involved 
the  selection  of  those  combat-related  tasks  on  which  estimates 
of  performance  effectiveness  would  be  obtained.  In  the  fifth 
task  the  various  instruments  were  used  to  collect  the  indicated 
predictor  and  criterion  performance  data.  Analysis  of  the 
obtained  data  comprised  the  sixth  task. 

Selection  of  MOS 


Several  criteria  were  considered  in  selecting  an  MOS 
on  which  to  focus,  including  availability  of  soldiers,  within- 
MOS  combat-role  variability,  and  variety  of  day-to-day  activities 
of  incumbents.  As  a result,  the  HE  Armor  Crewman  MOS  was 
chosen  for  study  and  a battalion  of  HE  troops  at  Fort  Carson, 
Colorado,  was  scheduled  to  participate  in  the  data  collection 
effort. 

Selection  and  Elaboration  of  Variables 


An  attempt  was  made  to  assess  the  troops  involved  in  this 
study  along  a fairly  broad  range  of  potential  predictor 
variables.  The  intent  was  basically  twofold:  first,  to  deter- 
mine the  variables  that  predicted  proficiency  in  combat-related 
tasks  for  the  specific  sample  of  troops  involved  in  this  study; 
and  second,  to  measure  some  of  the  variables  that  might  affect 
performance  for  a wider  range  of  Army  jobs. 

There  were  basically  four  classes  of  independent  variables: 
Personal  Background,  Army  Background,  Job  Background,  and 
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Congruence. * The  first  group  of  variables  of  potential  interest 
involved  what  the  soldier  "brings"  to  the  Army.  These  Personal 
Background  variables  were  initially  viewed  as  potential  modera- 
ting  or  intervening  variables  for  the  prediction  of  proficiency. 

Six  personal  background  variables  were  selected  for 
examination.  These  were: 

• Level  of  education, 

• Aptitude  test  score  (measured  as  the  mean 
of  the  test  scores  reported  for  a given 
soldier's  aptitude  test  battery), 

• Height, 

• Weight, 

• Handedness,  and 

• Age. 

Two  additional  variables  were  selected  that  were  not 
strictly  personal  background  as  described  above,  but  were 
hypothesized  to  potentially  play  the  same  moderating  or  inter- 
vening function.  These  concerned  a soldier's  general  attitude 
toward  the  Army  and  his  present  job.  The  soldiers  were  asked: 

• "Do  you  like  your  present  job?",  and 

• "Do  you  plan  to  reenlist?" 

Both  were  presented  as  yes-no  questions. 

The  second  group  of  variables  involved  a soldier's  Army 
Background.  These  variables  were  included  for  exploratory 
purposes — the  sample  of  HE  soldiers  might  yield  an  indication 
of  the  types  of  relationships  which  existed,  and  whether  these 
relationships  changed  for  different  positions  or  jobs. 


For  more  details  regarding  the  rationales  for  variable  inclu- 
sion and  units  of  measurement,  the  reader  is  referred  to 
Rose  and  Wheaton  (op.  cit.). 


Five  variables  were  chosen  as  indicators  of  Army  Back- 
ground, These  were: 

• Years  in  active  military  service, 

• Rank, 

• BCT:  whether  or  not  a soldier  had  gone  through 
a normal  Army  progression,  including  Basic 
Combat  Training, 

• AIT:  whether  or  not  a soldier  had  completed 
Advanced  Individual  Training,  and 

• Relevance  of  other  Army  training. 

The  third  set  of  variables  was  concerned  with  a soldier's 
Job  Background.  These  variables  were  selected  to  indicate  a 
particular  soldier's  history  and  experience  with  respect  to 
the  HE  MOS. 


five  variables  selected  were: 

• 

Time  in  11E  MOS, 

• 

11E  skill  level. 

• 

Time  in  crew. 

• 

Number  of  different  positions  held 
gunnery  programs , and 

during  tank 

• 

Number  of  Table  VIII 's,  regardless 
held. 

of  position 

The  fourth  set  of  independent  variables  was  selected  to 
measure  various  aspects  of  job-position  correspondence.  In 
essence,  these  Congruence  variables  attempted  to  assess  what 
a soldier  does  on  a day-to-day  basis  rather  than  what  his 
assigned  combat  position  would  be.  Each  of  these  variables 
was  tied  to  the  particular  duty  position  in  which  the  soldier 
was  to  be  tested.  These  congruence  variables  were  viewed  as 
the  primary  independent  variables  of  this  study;  it  was  hypothe- 
sized that  the  relationship  between  these  variables  and  perfor- 
mance would:  1)  indicate  if  there  was  a potential  problem  for 
the  Army  due  to  the  job-position  mismatch;  2)  define  the 
general  nature  and  scope  of  the  problem,  and  3)  provide  an 
indication  of  the  nature  of  the  relationships  and  possible 
mediating  circumstances. 


Eight  Congruence  variables  were  selected  for  exploration. 
These  were; 

• Time  in  duty  position, 

• Duty  position  skill  level, 

• Duty  position  congruence  (whether  the  soldier's 
duty  position  was  the  same  as  his  position  for 
the  current  performance  test) , 

• Position  training  congruence  (whether  the  soldier 
had  held  his  tested  position  during  tank  gunnery 
programs) , 

• Table  VIII  position  congruence, 

• Time  in  tested  position, 

• Hours  per  day  in  tested  position,  and 

• Platoon  Sergeants'  ratings. 

The  final  two  predictor  variables  were  concerned  with 
each  soldier's  particular  practice  experience  for  the  hands- 
on  performance  tests  of  this  study.  For  each  task  on  which  he 
would  be  tested,  the  soldier  was  asked  to  indicate  how  often 
he  practiced  it  and  the  last  time  he  had  performed  the  task. 

Data  Collection  Instruments 


Two,  paper-and-pencil,  group  administered  instruments 
were  developed  to  obtain  detailed  information  on  the  background 
and  task  congruence  variables  that  were  to  be  used  as  predictors 
of  combat-related  task  performance.  These  were,  respectively, 
the  Background  Information  Questionnaire  (BIQ)  and  the  Job 
Information  Survey  (JIS) . 

Background  Information  Questionnaire.  The  BIQ  consisted 
of  two  parts.  The  £irst,  comprised  of  some  17  questions, 
required  short  fill-in  answers  or  multiple-choice  responses. 

The  intent  of  this  first  set  was  to  develop  information  about 
troops'  personal  background  (e.g.,  age,  height,  weight,  level 
of  education),  Army  background  (e.g.,  years  in  service,  rank), 
job  background  and  "congruence"  (e.g.,  job  title,  position 
assigned  to  for  the  research,  time  spent  in  that  position) . 

The  second  part  of  the  BIQ  was  designed  to  elicit  confidence 
estimates  from  troops  concerning  how  well  they  could  perform 
the  tasks  which  they  would  subsequently  be  tested  on.  While 
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not  exactly  equivalent,  the  tasks  presented  for  rating  were 
in  essence  composites  of  those  included  in  the  subsequent  hands- 
on  tests  and  covered  in  the  JIS  instrument. 

Job  Information  Survey.  The  JIS  was  designed  to  provide 
data  on  practice  effects.  Including  how  frequently  and  how 
recently  troops  had  practiced  or  performed  those  combat-related 
tasks  of  interest  in  the  study.  A given  soldier  was  to  respond 
only  to  that  portion  of  the  JIS  related  to  the  crew  position 
to  which  he  had  been  assigned  for  the  study.  Opposite  each 
task  listed  under  the  appropriate  crew  position  in  the  JIS, 
the  soldier  placed  one  checkmark  in  the  column  that  best 
described  how  frequently  he  performed  it,  and  another  in  a 
column  that  indicated  when  he  had  last  done  it. 

Hands-On  Performance  Tests  and  Measures 


The  primary  source  of  criterion  data  was  a set  of  hands- 
on  performance  tests  relating  to  each  crew  position  in  the 
M6OAIA0S  tank.  The  tasks,  collectively  known  as  the  Tank  Crew 
Skills  Test,  had  been  developed  by  HumRRO  under  contract  to 
the  USARIFU  at  Fort  Knox,  Kentucky,  and  represented  an  adap- 
tation of  earlier  work*  on  the  M48A5  tank  system.  The  purpose 
of  the  test  was  to  portray  the  readiness  of  individual  crewmen, 
focusing  in  particular  on  specific  aspects  of  performance  in 
need  of  remedial  training  or  practice.  As  a consequence,  the 
scoring  procedures  were  oriented  around  a step-by-step  appraisal 
of  performance  within  any  one  task.  This  made  it  meaningful 
to  portray  performance  in  terms  of  the  proportion  of  steps 
passed  or  failed  within  the  task  and  to  indicate  precisely 
which  steps  had  been  failed.  At  a slightly  more  general  level 
it  was  possible  to  describe  performance  on  the  overall  task 
as  successful  (GO)  or  as  needing  some  type  of  remediation 
(NO  GO).  Finally,  one  could  characterize  performance  in  terms 
of  the  proportion  of  all  tasks  that  were  GO.  Since  the  tests 
were  being  administered  to  tank  crewmen  at  Fort  Carson, 

Colorado,  as  part  of  a readiness  and  remediation  study,  arrange- 
ments were  made  to  support  that  effort  and  to  gain  access  to 
the  resulting  performance  data. 


Harris,  J.  H. , Osborn,  W.  C.,  & Boldovici,  J.  A.  Reserve 
component  training  for  operating  and  maintaining  the  M48A5 
tank.  ARI  Technical  Report  TR-77-A14  (NTIS:  ADA043057),  1977. 
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Data  Collection 


Subjects.  A total  of  216  troops  from  the  2nd  Battalion, 
34th  Armor,  4th  Infantry  Division,  garrisoned  at  Fort  Carson, 
Colorado,  took  part  in  the  data  collection  effort.  These 
soldiers  represented  the  2nd  Battalion's  full  complement  of 
54  four-man  crews.  The  soldiers  were  organized  according  to 
a Battalion  Battle  Roster  which  designated  the  crew  to  which 
they  would  belong  and  the  crew  position  (i.e.,  driver,  loader, 
gunner,  or  tank  commander)  which  they  would  occupy  during 
subsequent  testing.  The  data  collection  effort  of  the  present 
study  focused  on  these  assigned  positions.  The  Battle  Roster 
was  primarily  comprised  of  troops  from  the  battalion's  three 
line  companies,  each  of  which  fielded  17  crews,  and  secondarily 
from  its  Headquarters  Company  which  furnished  three  additional 
crews. 

Procedure.  Data  collection  was  accomplished  under  the 
direction  of  U.S,  Army  Research  Institute  Field  Unit  (USARIFU) 
and  HumRRO  personnel  from  Fort  Knox,  Kentucky  as  part  of  a 
larger  research  effort  involving  tank  crew  gunnery.  These 
individuals  established  liaison  with  the  2nd  of  the  34th, 
monitored  development  of  the  subject  samples,  trained  test 
administrators,  supervised  collection  of  the  hands-on  per- 
formance test  data,  and  administered  background  information 
questionnaires  and  job  information  survey  instruments.  USARIBSS 
personnel  participated  in  the  planning  and  orchestration  of 
the  effort  while  staff  from  AIR  focused  on  troops'  completion 
of  the  questionnaires  and  surveys  and  on  the  retrieval  of 
additional  background  data  from  the  soldiers'  personnel  records. 

Data  were  collected  during  two  waves,  each  lasting  approxi- 
mately one  week.  Half  of  the  sample  of  216  troops  was  tested 
during  each  week.  Approximately  36  troops  (i.e.,  nine  crews) 
were  processed  on  each  of  two  days.  In  general,  troops  first 
responded  to  the  BIQ,  completing  it  for  the  crew  position  to 
which  they  had  been  assigned.  They  then  reported  to  the  hands- 
on  performance  testing  location.  One  to  three  days  after 
testing,  troops  completed  the  JIS  instrument  which  provided 
frequency  and  recency  of  practice  data  about  the  hands-on 
tasks  which  they  had  performed  earlier  in  the  week. 

Completed  questionnaires,  test  booklets,  release  forms, 
surveys,  etc.,  were  organized  on  a subject-by-subject  basis 
to  create  an  initial  raw  data  file  structure.  With  the  aid 
of  this  information  three  additional  steps  were  taken.  First, 
soldiers  whose  files  were  incomplete  were  followed  up  in  an 
attempt  to  reduce  missing  data.  Second,  release  forms  were 
taken  to  the  Enlisted  Personnel  Records  Section  where  personnel 
folders  were  examined  in  order  to  extract  specific  kinds  of 
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background  and  aptitude  data.  Third,  for  all  tested  troops, 
brief  interviews  were  arranged  with  their  platoon  sergeants. 
These  supervisory  personnel  described  and  provided  insights 
into  the  normal  duty  activities  of  the  troops  comprising  the 
study  sample  on  an  individual-by-individual  basis.  They  also 
provided  estimates  of  task  criticality  that  were  to  be  used 
as  criteria  for  selecting  a subset  of  tasks  for  intensive 
analysis.  Essentially  the  same  data  collection  procedures 
were  used  in  the  second  wave  which  occurred  two  weeks  later. 

Data  Analysis 

Data  collected  in  the  field  were  subsequently  scored, 
transferred  to  coding  sheets,  and  punched  onto  cards  for 
computer  processing.  The  resulting  data  base  was  of  formidable 
size  and  complexity  even  when  attention  was  limited  to  those 
variables  of  direct  relevance  to  the  current  study.  Some  form 
of  predictor  or  criterion  data  was  available  on  200  soldiers? 
these  200  cases  clustered  naturally  into  four  smaller  and 
independent  crew  position  data  bases.  Instances  of  missing 
data  were  frequent.  Within  any  given  data  base  there  were  as 
many  as  28  potential  predictor  variables  which  could  be  related 
to  as  many  as  27  hands-on  performance  tests;  finally,  three 
different  kinds  of  dependent  criterion  measures  were  available, 
including  proportion-of-steps- passed  and  GO/NO-GO  measures  on 
each  test  and  a more  global  measure  representing  the  proportion 
of  tasks  within  each  crew  position  that  were  GO. 

To  resolve  the  complexities  inherent  in  the  data  base  and 
to  reduce  the  amount  of  analysis  to  manageable  size,  the 
decision  was  made  to  treat  each  crew  position  separately,  view- 
ing the  four  sets  of  analyses  as  replications  of  the  basic 
task  congruence  and  performance  effectiveness  theme.  Within 
each  replicate  a three-pronged  analytical  strategy  was  pursued. 
First,  a principal  components  factor  analysis  with  rotation 
, to  a varimax  criterion  was  used  to  explore  the  dimensionality 

of  the  personal,  Army,  and  job  background  predictor  variable 
set.  The  outcome  of  this  analysis  was  to  be  used  to  specify 
a potentially  smaller  set  of  less  redundant  variables  with 
which  to  work.  Second,  a comparable  analysis  of  the  criterion 
— tests  was  undertaken  within  each  crew  position,  the  dependent 

variable  being  proportion  of  steps  passed  within  each  test. 

Again  the  objective  was  to  reduce  the  set  of  100  tasks  to  a 
more  reasonable  size.  Given  predictor  and  criterion  variable 
sets,  the  third  step  was  to  explore  their  interrelationships 
by  means  of  multiple-regression  techniques. 

The  results  of  these  analyses  are  presented  and  discussed 
in  full  in  a recent  Technical  Report  (Rose  & Wheaton,  op.  cit.). 
The  following  section  briefly  describes  some  of  the  more  per- 
*•  tinent  findings. 
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Results 


Descriptive  Information.  As  the  first  step  in  the  data 
analyses,  descriptive  information  was  generated  for  the  four 
crew  positions  on  each  of  the  background  and  congruence  variables. 
The  general  "picture"  of  a driver  as  indicated  by  the  personal 
and  Army  background  information  was  of  a high-school-educated 
21-year  old  who  had  been  in  the  Army  for  a little  over  two 
years,  had  gone  through  BCT  and  AIT  and  had  achieved  a rank  of 
E3  or  E4.  With  regard  to  his  job  background,  he  had  held  the 
title  of  11E20  for  approximately  one  and  a half  years,  had 
worked  in  a crew  slightly  longer,  had  held  one  position  during 
training,  and  had  been  tested  on  Table  VIII  once.  The  same 
picture  was  generally  true  for  loaders,  except  it  appeared 
that  some  of  them  had  "cycled  through"  the  driver  position. 

Thus,  as  compared  to  drivers,  loaders  had  been  in  the  Army  for 
almost  one  year  longer,  had  a slightly  higher  rank,  had  been 
in  the  HE  MOS  and  in  crew  longer,  and  half  of  them  had  gone 
through  more  than  one  position  during  training  and  Table  VIII 
testing. 

In  addition  to  being  older  and  having  more  education, 
the  gunners  were  more  experienced  than  either  drivers  or  loaders. 
They  had  achieved  a higher  rank  and  skill  level  and  had  held 
the  HE  MOS  for  more  than  two  years.  They  had  been  in  a crew 
longer  and  had  gone  through  previous  training  and  testing  cycles 
in  two  different  positions. 

Tank  commanders  were  substantially  different  from  the  other 
positions  on  several  variables.  They  were  better  educated, 
older,  had  been  in  the  Army  much  longer  (seven  years  versus 
two  to  three  for  the  other  positions) , and  had  achieved  higher 
ranks  than  the  other  positions.  Also,  they  had  a higher  pro- 
bability of  reenlisting  and  liked  their  job  more  than  the  other 
positions. 

Congruence  Variables.  The  position- job  match  variable 
is  the  purest  but  least  sensitive  congruence  variable,  since 
the  question  is  simply  whether  or  not  a soldier  is  performing 
his  job  in  a position  to  which  he  was  assigned  for  the  research. 
All  crew  positions  (with  the  exception  of  loaders)  were  filled 
by  80-87%  "appropriate"  personnel.  It  is  difficult  to  say 
whether  this  is  a high  proportion,  relative  to  the  range  of 
Army-wide  combat  positions;  furthermore,  this  is  only  a gross 
measure,  since  it  does  not  assign  a congruence  score  to  any 
particular  referrent  set  of  tasks  for  a position.  On  the  other 
hand,  the  80-87%  figures  might  be  artificially  high  for  llE's 
compared  to  other  Army  MOSs  due  to  the  fairly  restricted  range 
of  positions  in  the  MOS.  The  relatively  low  position- job 
match  score  for  the  loaders  (58%)  may  indicate  that  loaders 
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have  a fairly  narrow  and  delimited  range  of  tasks  unique  to 
the  position.  Thus,  during  peacetime,  it  is  more  likely  that 
loaders  will  perform  other  non-specialized  crew  duties;  or  per- 
haps for  the  purposes  of  this  research,  the  loader  position  was 
viewed  as  least  demanding  on  unexperienced  personnel  who  were 
tapped  to  fill  out  crews  by  manning  this  position. 

The  two  questions  which  asked  whether  or  not  the  soldier 
had  gone  through  a training  cycle  in  his  tested  position  and 
whether  or  not  he  had  gone  through  a Table  VIII  in  that  posi- 
tion produced  highly  similar  responses  across  the  four  positions. 
About  one  half  of  the  soldiers  responded  positively  to  each 
question,  with  the  only  exception  being  the  tank  commanders' 

Table  VIII  experience.  Over  80%  said  that  they  had  gone 
through  the  Table  VIII  as  a tank  commander.  It  is  possible 
that  these  training  and  Table  VIII  numbers  are  not  representa- 
tive of  llE's  Army-wide  in  that  these  particular  companies 
had  recently  completed  a fairly  extensive  (but  unrelated  to 
this  study)  training  and  testing  program. 

The  hours-per-day  variable  indicated  that  loaders  and 
gunners  spent  less  time  on  their  position-related  tasks  than 
did  drivers  and  tank  commanders.  This  finding  is  consistent 
with  the  hypothesis  that  loaders  and  gunners  are  restricted 
by  the  nature  of  their  jobs:  loaders  cannot  practice  loading, 
nor  can  gunners  practice  firing,  due  to  resource  constraints. 


Intercorrelations  of  Background  and  Congruence  Variables. 

The  next  stage  of  the  analyses  was  designed  to  examine  the 
relationships  and  interrelationships  among  the  background  and 
congruence  variables.  There  were  two  purposes  for  this  step: 
first,  the  zero-order  correlations  could  be  of  interest  in 
their  own  right;  and  second,  as  mentioned  above,  it  was 
necessary  to  resolve  the  complexities  inherent  in  the  data  base 
and  to  reduce  the  data  to  a manageable  size.  Given  that  the 
general  analytic  design  was  a regression  paradigm,  it  was 
important  to  carefully  select  independent  variables.  One 
selection  strategy  was  to  screen  a large  set  of  variables  and 
delete  redundant  and  irrelevant  ones  (with  respect  to  performance 
prediction) . This  could  be  done  from  an  examination  of  the 
intercorrelation  matrixes  and  the  factor  analysis  of  these 
ma trixes. 


The  net  result  of  these  analyses  was  to  eliminate  several 
variables  as  predictors  of  hands-on  performance.  The  variables 
omitted  from  the  regression  analyses  were:  aptitude  test  scores 
mean,  height,  weight,  handedness,  "like-job,"  and  "reenlist" 
from  the  Personal  Background  variables,  and  BCT,  AIT,  and 
relevance  of  other  training  from  the  Army  Background  variables. 
Two  others  dealing  with  secondary  MOS  were  also  eliminated 
because  they  were  found  to  have  zero  variance  in  the  sample. 


12 


Recency  and  Frequency  of  Task  Performance.  The  final  two 
predictor  variables  were  recency  and  frequency  of  task  perfor- 
mance. They  were  treated  separately  not  only  because  they 
varied  within  crew  position  on  a task-by-task  basis,  but  also 
because  they  represented  conceptually  distinct  aspects  of 
congruence,  worthy  of  study  in  their  own  right. 

In  summary,  the  recency  and  frequency  data  ran  the  gamut 
across  the  100  tasks  comprising  the  hands-on  readiness  test 
battery.  Many  tasks  had  not  been  practiced  by  appreciable 
proportions  of  each  crew  position  sample.  This  lack  of  prac- 
tice might  be  due  to  troops  who  were  assigned  crew  positions 
for  the  study  that  they  did  not  normally  occupy  or  that  they 
had  occupied  for  a relatively  short  period  of  time.  At  the 
other  extreme  were  tasks  on  which  performance  was  relatively 
frequent  and  which  had  been  practiced  quite  recently.  With 
the  exception  of  drivers,  however,  who  had  substantial  practice 
in  driving,  the  most  frequently  performed  tasks  tended  to  deal 
with  preparation  for  operations  and  maintenance.  This  lack 
of  intensive  practice  on  more  tactical  tasks  is  presumably 
characteristic  of  combat  troops  in  peacetime. 

Hands-On  Performance  Tests.  Because  of  the  exploratory 
thrusts  of  the  effort  and  the  need  to  conserve  resources  it  was 
decided  that  during  the  first  phase,  a subset  of  tasks  within 
each  of  four  crew  positions  would  be  examined  rather  than 
analyzing  the  full  set  of  100  tests.  Accordingly,  an  analytical 
strategy  was  devised  and  implemented  for  pinpointing  those  tasks 
having  initial  promise  in  addressing  the  task  congruency  and 
performance  effectiveness  hypothesis. 

The  first  step  in  selecting  criterion  tasks  was  to  score 
performance  on  each  of  the  100  in  terms  of  the  proportion  of 
steps  (scorable  units)  successfully  completed.  These  scores 
were  used  in  the  initial  analyses  in  order  to  maximize  the 
yield  of  diagnostic  information  about  each  task  and  to  promote 
variability  in  troops'  performance  scores,  the  latter  being 
an  important  consideration  in  trying  to  create  an  optimal  set 
of  conditions  under  which  to  explore  the  hypothesized  relation- 
ship between  task  congruence  and  performance. 

Descriptive  analyses  run  on  the  tasks  comprising  each 
crew  position  revealed  several  interesting  findings.  Perfor- 
mance levels  were  characteristically  high  (ranging  from  a mean 
on  one  driver  task  of  .57  to  a mean  of  .99  for  a commander  task) 
and  showed  relatively  little  variability  among  soldiers  (e.g., 
variances  ranged  on  individual  tasks  from  .0009  to  .25).  The 
latter  statistic  revealed  much  more  consistent  performance  in 
the  sample  of  troops  than  had  been  anticipated,  based  on  the 
number  of  "fills"  in  the  study,  the  range  of  time  in  duty  posi- 
tion, the  fact  that  many  troops  reported  not  having  performed 
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several  of  the  tasks  during  the  previous  year,  and,  when  they 
had  done  so,  the  varied  patterns  of  practice  which  seemed  to 
typify  the  sample. 

In  order  to  select  specific  tasks  to  focus  on  in  each 
crew  position,  the  factor-analytic  approach  used  earlier  to 
screen  predictor  variables  was  again  pursued.  The  proportion- 
of-steps-passed  performance  data  were  intercorrelated  for  all 
tasks  within  each  crew  position,  and  the  four  intercorrelation 
matrixes  were  then  examined  by  means  of  a principal  components 
solution,  with  rotation  of  factors  to  a varimax  criterion. 

Other  considerations  for  the  final  selection  of  tasks  revolved 
around  their  judged  criticality  (the  more  critical  being  more 
desirable) , the  number  of  steps  involved,  and  on  their  variances 
(greater  variance  being  an  asset  in  the  eventual  regression 
analyses).  A sample  of  19  tasks,  or  roughly  20%  of  the  total 
set,  was  selected  for  examination  in  the  subsequent  regression 
analyses.  Five  tasks  were  used  to  represent  drivers,  six  came 
from  the  loader  set,  four  were  drawn  from  gunner  tasks,  and 
four  were  used  to  represent  the  tank  commander  position. 

Zero-Order  Validities.  As  the  final  step  in  preparation 
for  the  multiple-regression  analyses,  the  zero-order  validity 
(correlation)  coefficients  between  the  predictor  and  criterion 
variables  within  each  crew  position  were  computed.  The  pre- 
dictors were  comprised  of  background,  congruence,  and  practice 
variables.  Criterion  measures  were  proportion  of  steps  passed, 
proportion  of  troops  acquiring  a GO  on  each  task,  and  the 
proportion  of  all  tasks  within  a position  on  which  a on  was 
received. 


With  respect  to  the  proportion  of  steps  passed  by  task, 
relatively  few  highly  significant  (p  < .01)  relationships 
were  obtained.  Those  relationships  which  did  exist  were 
confined  primarily  to  the  driver  and  loader  positions.  In 
particular,  a number  of  significant  relationships  were  found 
in  the  latter  position.  These  involved  job  background,  con- 
gruence, and  Army  background  predictor  variables.  This  same 
general  pattern  was  repeated  with  respect  to  the  task  and 
overall  GO  proportions.  Subsequent  analyses  were  devoted  to 
exploring  these  relationships  for  multiple  as  opposed  to  single 
predictor  variables. 

Multiple  Regressions.  Given  the  general  exploratory  nature 
of  this  first  phase  of  the  study,  the  large  number  of  potential 
predictor  variables,  and  the  relatively  small  (statistically) 
sample  of  soldiers,  the  selection  of  an  adequate  regression 
technique  posed  some  problems.  After  considering  several 
alternatives,  the  "all  possible  subsets  regression"  procedure 
was  selected.  This  analysis  estimates  regression  equations 
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for  "best"  subsets  of  predictor  variables  and  does  extensive 
residual  analysis.  Best  is  defined  in  terms  of  the  sample  R- 
squared,  adjusted  R-squared,  or  Mallows'  Cp. 

Turning  now  to  an  examination  of  the  results,  there  were 
several  fascinating  and  somewhat  unexpected  findings.  The 
first  and  most  critical  issue  is  whether  the  entire  set  of 
variables  actually  predicted  a significant  proportion  of  variance 
in  performance.  The  answer  was  clearly  yes.  Thus,  despite  the 
grossness  of  the  scoring  rule  (i.e.,  overall  proportion  of 
tasks  for  which  the  soldier  passed  all  steps,  regardless  of 
the  number  of  steps  in  any  particular  task  or  substantial 
differences  in  difficulty  among  tasks) , there  was  predictable 
variance  for  each  crew  position. 

The  second  and  equally  critical  issue  was  whether  the 
congruence  variables  were  related  to  performance,  this  being 
the  basic  experimental  hypothesis  of  the  research  effort.  If, 
for  example,  none  of  these  variables  (singly  or  collectively) 
predicted  hands-on  task  performance,  the  initial  supposition 
that  a potential  problem  exists  for  peacetime  soldiers  in 
non-combat  positions  would  be  unjustified.  However,  it  was 
apparent  from  the  results  that  the  congruence  variables  were 
involved  and  actually  seemed  to  be  the  strongest  predictors. 

Therefore,  there  was  clear  support  for  the  project's  major 
thesis:  there  is  a strong  relationship  between  a soldier's 
day-to-day  activities  and  his  proficiency  on  combat-related 
tasks.  Furthermore,  the  nature  of  this  relationship  is  in 
the  logical  direction:  generally,  the  higher  a soldier's  con- 
gruence scores,  the  better  his  performance.  A third  aspect  of 
the  results  was  unexpected:  frequency  and  recency  of  practice 
were,  for  the  most  part,  nonpredictive  of  this  performance 
measure. 

Another  intriguing  aspect  of  the  results  was  the  pattern 
of  predictors  across  crew  positions.  There  were  some  simi- 
larities; for  example,  the  most  common  predictor  variable  for 
all  positions  was  on-the-job  experience  in  duty  position, 
measured  either  as  months  in  Duty  MOS  or  as  months  in  tested 
position.  However,  there  were  some  striking  dissimilarities. 

For  example,  different  background  variables  were  important  for 
different  positions;  furthermore,  some  of  these  changed  in 
sign  between  positions.  The  most  likely  explanation  unfor- 
tunately is  the  most  difficult  to  demonstrate  support  for — 
that  is,  the  differing  demands  on  the  soldiers.  Some  task 
performances  are  best  predicted  by  a soldier's  overall  back- 
ground and  experience,  others  by  specific  job  experience.  Each 
job  is  a combination  of  a variety  of  different  tasks;  hence 
no  generalizations  (beyond  those  made  above)  are  warranted. 
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Summary 

The  critical  findings  were  that  different  variables  pre- 
dicted performance  for  different  crew  positions  and  for  different 
tasks  within  positions.  Furthermore,  different  scoring  rules 
resulted  in  different  sets  of  predictors.  Thus,  these  results 
simply  were  not  systematic  enough  to  permit  the  development 
of  generalizable  findings. 

However,  during  the  course  of  the  investigation  a number 
of  potentially  important  research  issues  were  uncovered  that 
related  to  the  basic  thrust  of  the  study  but  which  could  not 
be  pursued  satisfactorily  within  the  first  phase  of  the  effort. 

As  summarized  below,  these  were  addressed  during  Phase  II. 

1 . Effects  of  Task  Congruity  on  Combat  Task  Performance. 
During  Phase  I,  this  central  issue  was  addressed  in  terms  of 
a small  number  of  selected  hands-on  readiness  test  scores. 

During  Phase  II,  the  scope  was  broadened  to  encompass  the 
more  extensive  information  about  performance  that  was  available. 
Specifically,  the  task  congruity  hypothesis  was  reexamined 
using  nearly  all  of  the  100  readiness  tasks  that  were  adminis- 
tered. 


2.  Additional  Performance  Data.  The  hands-on  performance 
tasks  used  in  the  present  investigation  are  relatively  new 
instruments  and  as  such  have  not  been  studied  or  evaluated  in 
detail.  Given  the  availability  of  data  from  a second  adminis- 
tration of  these  tests  to  many  soldiers  in  the  original  sample, 
it  would  be  important  to  compare  their  performance  on  both 
administrations.  This  analysis  would  indicate  the  extent  to 
which  scores  are  subject  to  variations  in  test  administration, 
an  artifact  of  potential  concern.  Also,  related  analyses 
could  be  conducted  on  the  SQT  performance  data  that  were 
available.  By  extending  the  analyses  to  SQT  data  it  would  be 
possible  to  determine  not  only  whether  different  peacetime 
duty  activities  are  related  to  varying  levels  of  proficiency 

on  combat-related  tasks  but  also  to  determine  whether  such 
relationships  actually  extend  to  skill  qualification  itself. 

The  existence  of  task  congruity  effects  on  qualification,  if 
demonstrated,  has  important  and  far-ranging  consequences  for 
the  structuring  of  duty  activities  and  refresher  training. 

3.  Confidence  Information.  The  soldiers'  own  esti- 
mates of  their  ability  to  perform  different  combat-related 
tasks  could  be  compared  to  their  actual  levels  of  performance. 
If  such  ratings  were  indeed  accurate  reflections  of  subsequent 
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performance  it  would  be  possible  to  use  them  as  proxy  measures 
of  a unit's  combat  readiness  that  pinpoint  specific  require- 
ments for  kinds  and  amounts  of  remedial  training.  If  demon- 
strated to  be  valid  estimates  of  performance,  these  ratings 
could  also  be  used  as  dependent  variables  in  an  examination 
of  the  task  congruity  hypothesis.  That  is,  these  ratings  could 
be  evaluated  as  surrogate  performance  measures  in  an  investi- 
gation of  the  congruence  variables. 

4.  Task  Taxonomy.  One  particularly  intriguing  aspect  of 
increasing  the  number of  tasks  examined  would  be  the  possi- 
bility of  uncovering  systematic  effects  due  to  task  "type". 

The  relatively  small  number  of  tasks  used  in  the  first  phase 
did  not  include  sufficient  samples  of  (for  example)  "procedural' 
"judgmental",  and/or  "cognitive"  tasks  so  that  relationships 
could  be  investigated.  It  is  possible  that  a "task  type" 
variable  could  untangle  some  of  the  inconsistencies  among  per- 
formance predictors  observed  in  cue  iimicea  data  set  studied 
in  Phase  I. 


I 


THE  DATA  SET  AND  PRELIMINARY  ANALYSES 


This  chapter  serves  three  basic  functions:  First,  it 
presents  the  initial  activities  undertaken  in  the  attempt  to 
clarify  the  unsystematic  relationships  found  in  Phase  I. 

Second,  it  presents  the  updated  and  new  information  in  the  data 
set;  this  information  was  used  as  input  to  the  remaining 
analyses  presented  in  this  report.  Finally,  it  discusses 
several  issues  not  directly  related  to  the  congruence-performance 
question,  that  nevertheless  are  important  in  their  own  right. 

Such  issues  include  an  examination  of  the  relationship  between 
Readiness  Test  performance  and  performance  on  a readministration 
of  the  test,  the  relationship  between  soldiers'  confidence 
estimates  of  their  ability  and  actual  performance,  and  the 
rationale  for  and  development  of  an  approach  to  improving  the 
quality  of  the  performance  data  which  could  incorporate  prac- 
tically the  entire  set  of  performance  tasks  administered  during 
Phase  I. 

Background  and  Congruency  Variables 

One  possible  reason  for  the  unsystematic  relationships 
between  background  and  congruency  variables  and  performance  as 
found  in  Phase  I was  the  quality  of  the  predictor  variables. 
Analyses  conducted  in  Phase  I suggested  that  some  of  these 
variables  might  have  been  redundant  or  were  inadequate  reflec- 
tions of  what  they  were  originally  intended  to  measure. 
Furthermore,  inconsistencies  in  individual  soldiers'  records 
(presumably  based  on  misinterpretations  of  specific  questions) 
could  have  led  to  the  unsystematic  results.  Therefore,  as  an 
initial  activity  in  Phase  II,  the  existing  data  base  was 
reexamined  and  edited. 

The  first  minor  editing  consisted  of  rescaling  of  two  vari- 
ables: the  Level-of-Education  variable  and  the  Years-Served 

variable.  For  the  former,  the  six-point  scale  previously  used 
was  modified  slightly  to  better  reflect  ordinal  points  in  a 
soldier's  educational  progress.  For  the  latter.  Years  Served  was 
converted  into  months  in  an  effort  to  increase  the  variability 
of  scores  (and  thereby  possibly  increasing  their  potential 
value  for  prediction) . As  a result  of  the  change  in  the  Level- 
of-Education  variable,  there  were  minor  changes  in  the  descrip- 
tive statistics  for  each  crew  position  as  compared  to  the  data 
presented  in  the  Phase  I Technical  Report.  The  means  and 
variances  for  drivers,  loaders,  and  gunners  increased  slightly, 
while  the  mean  and  variance  for  tank  commanders  decreased 
slightly.  The  conversion  of  Years  Served  into  months  essen- 
tially multiplied  the  previous  scores  by  12.  The  original  raw 
data,  expressed  in  terms  of  months,  were  used. 
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The  second  minor  editing  consisted  of  deleting  several 
variables  from  the  data  set.  It  was  decided  that  these  vari- 
ables, due  to  their  distributional  properties  and  uninterpre- 
tability  in  previous  analyses,  were  simply  adding  "noise"  to 
the  predictor  variables;  relationships  might  become  clearer  if 
they  were  omitted.  Thus,  the  variables  of  Aptitude  Scores 
Mean,  Handedness,  BCT,  AIT,  and  Relevance  of  Other  Training 
were  dropped  from  the  data  set. 

A final  major  alteration  of  the  data  set  was  prompted  when 
a reexamination  of  the  Tank  Commander  file  revealed  that  12  of 
the  59  tank  commanders  were  officers.  This  fact  had  produced 
some  "artifacts"  in  the  original  analyses.  For  example,  since 
officers  do  not  have  an  MOS  designation  in  the  EPMS,  such  vari- 
ables as  HE  Skill  Level  and  Months  in  Primary  MOS  had  no  meaning, 
and  were  erroneously  (or  correctly)  scored  as  zeros.  In  addi- 
tion, officers  follow  a different  career  progression  than 
enlisted  personnel;  it  would  be  difficult  at  best  to  attempt 
generalizations  regarding  tank  commanders  based  on  background 
and  experiential  information  from  a group  of  officers.  Thus, 
it  was  decided  to  delete  these  12  officers  from  the  file.  In 
an  effort  to  guage  the  potential  impact  of  this  deletion, 
descriptive  statistics  for  the  background  and  congruence  vari- 
ables for  officers  and  non-officers  were  computed.  Furthermore, 
for  those  variables  which  had  variance,  t-statistics  to  test 
mean  differences  were  calculated. 

Results  of  these  t-tests  showed  significant  differences 
between  officers  and  non-officers  on  eight  variables.  Officers 
were  younger  (25  years  old  vs.  28  years  old  for  non-officers), 
had  a higher  level  of  education  (roughly,  college  graduates 
vs.  high  school  graduates) , had  been  tank  commanders  for  a 
shorter  amount  of  time  (approximately  4 months  vs  7.3  months), 
had  been  in  a crew  for  less  time  (0.9  years  vs.  2.5  years), 
had  performed  fewer  Table  VIII' s (approximately  once  vs.  2.7 
times) , and  spent  fewer  hours  per  day  performing  tank  commander 
duties  (one  hour  per  day  vs.  4.2  hours).  Furthermore,  on  the 
average,  officers  liked  their  jobs  more  and  planned  to  "reenlist" 
more  frequently  than  non-officers.  All  other  background  and 
congruence  variables  showed  non-significant  differences.  Thus, 
the  deletion  of  the  officers  clearly  changed  the  descriptive 
statistics  for  the  tank  commanders  and  potentially  had  an 
impact  on  the  correlations  between  background  and  congruence 
variables  and  the  criterion  measures.  These  effects  will  be 
discussed  in  appropriate  sections  of  this  report;  however,  all 
succeeding  analyses  (including  tank  commanders)  conducted  in 
Phase  II  used  the  reduced  (non-officer)  data  set. 

In  order  to  examine  if  any  of  these  revisions  in  the  data 
set  had  a major  effect,  intercorrelations  among  the  background 
and  congruence  variables  were  computed,  along  with  means 
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and  standard  deviations  for  each  variable  within  each  crew 
position.  These  data  were  then  compared  with  Tables  3A  through 
3D  and  4A  through  4D  in  the  previous  Technical  Report.  With 
respect  to  the  descriptive  data,  the  results  were  clear:  with 
the  exceptions  noted  above  (i.e..  Level  of  Education,  Months 
Served,  and  the  various  Tank  Commander  variables) , and  a drop 
in  the  Duty  Congruence  score  from  80%  to  67%  for  drivers,  the 
editing  of  the  data  base  did  not  substantially  change  either 
the  means  or  variances  of  any  variable.  Therefore,  rather  than 
present  four  lengthy  tables  of  descriptive  information.  Tables 
3A  through  3D  of  the  previous  Technical  Report  can  be  assumed 
to  accurately  reflect  the  characteristics  of  the  troops  in  this 
study. 

The  "new"  intercorrelation  matrixes  were  carefully  com- 
pared to  the  previous  matrixes.  As  could  be  expected,  minor 
differences  appeared.  Formal  statistical  tests  for  comparison 
of  correlational  patterns,  while  available,  were  judged  to  be 
inappropriate  for  the  small  sample  sizes  and  non-normal  dis- 
tributions of  most  of  the  variables.  Again,  rather  than  repro- 
duce Tables  4A  through  4D  of  the  previous  Technical  Report  with 
minor  revisions,  it  can  be  assumed  that  these  matrixes 
adequately  express  the  pattern  of  relationships  among  the 
background  and  congruence  variables. 

Criterion  (Performance)  Data 


Another  potential  cause  of  the  unsystematic  relationships 
found  during  Phase  I (and  discussed  in  the  previous  Technical 
Report)  was  the  nature  of  the  obtained  performance  data.  For 
example,  most  of  the  Readiness  Test  items  had  highly  skewed 
distributions;  many  had  little  or  no  predictable  variance;  and 
different  scoring  rules  resulted  in  different  sets  of  signifi- 
cant predictor  variables.  As  mentioned  in  the  review  above,  it 
was  decided  to  conduct  extensive  analyses  on  a few  selected 
tasks  rather  than  on  the  entire  set  of  100  potential  criterion 
tasks.  The  tasks  selected  were  chosen  to  maximize  predict- 
ability: for  the  most  part,  they  were  the  tasks  with  the  most 
variability,  least  skewness,  and  where  the  different  scoring 
rules  did  not  change  their  relative  difficulty.  However,  this 
approach  had  one  major  drawback:  it  sacrificed  a large  propor- 
tion of  potentially  revealing  information  contained  in  the 
performance  data  associated  with  the  remainder  of  the  tasks. 

Another  approach  to  improving  the  quality  of  the  perfor- 
mance data  which  does  not  involve  ignoring  substantial  portions 
of  the  data  base  was  adopted  for  Phase  II.  This  approach 
consisted  of  pooling  tasks;  that  is,  to  combine  several  similar 
individual  tasks  into  larger  homogeneous  groups.  Typically, 
pooling  of  variables  ameliorates  distributional  abnormalities. 
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decreases  skewness,  and  increases  variance  compared  to  individual 
items.  Thus,  if  a rational  basis  could  be  found  for  grouping 
all  of  the  tasks  into  smaller  set3,  the  possibility  for  clari- 
fying the  nature  of  the  relationship  between  congruence  and 
combat  readiness  would  be  substantially  improved. 

There  were  many  possible  bases  for  establishment  of  com- 
posite groups  of  criterion  tasks.  One  such  rationale  is  explored 
in  a later  section,  where  a task  taxonomy  based  on  considerations 
of  learning,  retention,  and  practice  requirements  is  developed. 
Another  rationale  is  for  tasks  to  be  grouped  on  the  bases  of 
similarity  of  equipment  involved  and  similarity  of  functional 
requirements  of  tasks.  For  example,  an  obvious  grouping  of 
driver  tasks  is  to  combine  all  tasks  involved  in  installing 
and  operating  the  periscopes  (i.e.,  all  tasks  involving  the 
same  piece  of  equipment) ; another  obvious  group  of  driver  tasks 
is  the  combination  of  tactical  driving  tasks  in  non-engagement 
situations  (e.g. , crossing  a vertical  obstacle,  crossing  a ditch, 
ascending  and  descending  steep  grades,  etc.).  This  group  is 
a "functional"  group,  all  tasks  involving  actual  driving.  This 
basis  for  grouping  tasks  has  one  further  practical  advantage: 
during  Phase  I data  collection,  troops  were  requested  to  esti- 
mate their  confidence  in  their  ability  to  perform  certain  tasks. 
The  tasks  that  they  rated  were,  in  fact,  composites  formed 
precisely  according  to  the  above  rationale.  Thus,  by  adopting 
this  basis  for  task  grouping,  it  would  be  possible  to  straight- 
forwardly explore  the  relationship  between  a soldier's  confi- 
dence and  his  actual  performance. 

The  reconstituted  task  groups  and  the  correspondence 
between  these  groups  and  the  tasks  in  the  Readiness  Test  are 
shown  in  Table  1 for  each  crew  position.  As  can  be  seen,  20 
of  the  23  Driver  tasks  fall  nicely  into  five  groups.  These 
groups  include  servicing  and  operating  the  periscopes,  starting 
up  the  tank,  preparing  to  fire,  driving  in  non-combat  situations, 
and  tactical  combat  driving.  Three  Readiness  Test  items  which 
did  not  conveniently  fit  any  of  these  groups  were  excluded 
for  most  of  the  remaining  analyses,  principally  because  drivers 
did  not  provide  confidence  estimates  for  these  tasks.  For 
the  remaining  positions,  20  of  the  27  Loader  tasks  were  collapsed 
into  11  groups;  and  21  of  the  26  Tank  Commander  tasks  were 
collapsed  into  10  groups.  Thus,  78  of  the  original  99  Readi- 
ness Test  items  were  included  in  the  reconstituted  groups. 

Given  this  restructuring  of  the  criterion  performance  data 
set,  several  new  scores  had  to  be  created  for  each  soldier. 

Thus,  not  only  were  performance  scores  for  each  task  group 
computed,  but  also  new  recency  and  frequency  averages  were 
calculated.  Table  2 shows  the  descriptive  data  of  Readiness 
Test  performance  for  each  task  group.  It  was  decided  that 
the  "proportion  of  steps  passed"  would  be  used  as  the 
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Table  1.  Correspondence  Between  Readiness  Tests 
and  Ccrposite  Criterion  Task  Groups 


DRIVER  TASKS 
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Task  Group 

1.  Remove  M27  and  install  M2 4 peri- 
scopes, perform  before  operations 
checks  and  services  on  the  peri- 
scopes, and  place  M24  periscope 
into  operation. 


Readiness  Test  Items 

1.  Remove  M27  periscope. 

2.  Perform  before  operation  checks 
and  services  on  the  M24  and  M27 
periscopes . 

3.  Install  M2 4 periscope. 

4.  Place  M24  periscope  into  opera- 
tion. 


2.  Perform  operations  previous  to 

6. 

Start  tank  engine. 

starting  tank  engine,  start  tank 
engine  and  place  tank  in  motion. 

7. 

Perform  before  operation  checks 
and  services  on  tank  engine  and 
transmission  oil  levels. 

8. 

Place  tank  in  motion. 

3.  Perform  driver's  procedures  pre- 

10. 

Perform  prepare- to- fire  pro- 

paring  to  fire  main  gun. 

cedures. 

4.  Driving  a tank  in  tactical  sit- 

11. 

Operate  tank  in  neutral  steer. 

uations,  including  driving  in  neu- 
tral steer,  crossing  obstacles  and 

12. 

Cross  a vertical  obstacle. 

ditches,  driving  up  find  down  steep 

13. 

Cross  a ditch. 

hills,  and  driving  through  water 
obstacles. 

14. 

Ascend  a steep  grade. 

15. 

Descend  a steep  grade. 

16. 

Drive  over  a water  obstacle. 

5.  Driving  in  tactical  situations, 
including  performing  evasive  maneu- 
vers, driving  into  defilade  position, 
and  driving  in  response  to  fire 
commands  during  target  engagement. 


17.  Perform  evasive  maneuver  upon 
"enemy"  contact  by  following 
tank  ccmnander  ccmrands. 

18.  Perform  evasive  maneuver  upon 
"enemy"  contact  by  beginning 
evasive  maneuver  on  own  initia- 
tive. 

19.  Drive  into  defilade  position 
upon  "enemy"  contact. 

20.  Drive  in  response  to  fire 
contend  during  target  engagement. 
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Table  1.  Correspondence  Between  Readiness  Tests 
and  Oonposite  Criterion  Task  Groups  (cant'd. ) 


l. 


DRIVER  TASKS  (cont'd.) 

Task  Group 

Readiness  Test  Items 

1 J 

5.  (cont'd.)  21. 

Drive  to  a halt  in  response  to 
fire  ccnmand. 

L 

22. 

Lock  brakes  during  a stationary 
engagement . 

L 

Readiness  Test  Items  not  included  in  Task  Groups. 

5.  Perform  before  operation  checks  and  services 
on  gas  particulate  unit. 

9.  Check  track  tension. 

23.  Acquire  targets. 


C 

E 

E 


LOADER  TASKS 


1.  Check  and  adjust  track  tension. 

2.  Check  track  tension. 

3.  Adjust  track  tension. 

2.  Boresight  an  M219  machinegun 
mounted  on  a tank. 

7.  Boresight  M219  machinegun. 

3.  Stow  main  gun  rounds  in  tank. 

8.  Stow  main  gun  rounds  in  tank. 

4.  Perform  prepare- to-fire  proce- 
dures from  loader's  station. 

9.  Perform  prepare- bo- fire  proce- 
dures. 

5.  Load  main  gun  in  response  to  fire 
command;  change  type  of  loaded  round. 

10.  Load  main  gun  in  response  to 
fire  command. 

a.  Battlesight  with  SABOT  loaded. 

b.  Main  gun  not  loaded. 

c.  Main  gun  loaded  with  SABOT 
but  some  other  ammunition 
is  called  for. 
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Table  1.  Correspondence  Between  Readiness  Tests 
and  Composite  Criterion  Tbsk  Groups  (oont'd. ) 


ICAEER  TASKS 

(cant'd.) 

Task  Group 

Readiness  Test  Items 

6.  In  response  to  main  gun  misfire. 

12. 

Rotate  round  in  misfire  proce- 

perform  "rotate  round"  procedure  and 

dure. 

unload  procedure. 

13. 

Unload  misfired  main  gun  round. 

7.  Apply  action  to  reduce  stoppage 

14. 

Apply  inmndiate  action  to  reduce 

of  M219  machinegun. 

stoppage  in  M219  machinegun. 

8.  Maintain  the  M219  machinegun 

15. 

unload  M2 19  machinegun. 

including  unloading,  removal  from 
tank,  disassembly,  inspection, 

16. 

Remove  M219  machinegun  from 
tank. 

assembly,  checking  operation,  and 

mounting  on  a tank. 

17. 

Disassemble  M219  machinegun. 

18. 

Inspect  M2 19  machinegun. 

19. 

Assemble  M219  machinegun. 

20. 

Check  operation  of  M219  machine- 
gun. 

21. 

Mount  M219  machinegun  on  tank. 

9.  Maintain  the  main  gun  breech- 

23. 

Remove  main  gun  breechblock. 

block,  including  removal,  disassem- 
bly, assembly,  and  installation. 

24. 

Disassemble  main  gun  breech- 
block. 

25. 

Assemble  main  gun  breechblock. 

26. 

Install  main  gun  breechblock. 

Readiness  Test  I tore  not  included  in  Task  Groups. 

1.  Perform  before  operation  checks  and  services  on 
tank  engine  and  trananission  oil  levels. 

4.  Check  operation  of  M3  heater. 

5.  Prepare  tank  for  boresighting. 

6.  Check  boresight  alignment  of  main  gun. 

11.  Ready  M219  machinegun  in  response  to  fire  ccmmnd. 
22.  Load  M219  machinegun. 

27.  Read  replenisher  tape. 
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Table  1 . Correspondence  Between  Readiness  Tests 
and  Composite  Criterion  Task  Groups  (cont'd.) 


* • GUNNER  TASKS 

Task  Group  Readiness  Test  Items 

1.  Perform  gunner's  procedures  4.  Perform  prepare- to- fire  proce- 

preparing  to  fire  rain  gun.  dures. 


2.  Prepare  gunner's  telescope  for  6.  Prepare  telescope  for  operation, 

operation. 

■ 

3.  Prepare  gunner's  periscope  for  7.  Prepare  periscope  for  daylight 

operation.  operation. 


L 

l 

l 


4.  Prepare  azimuth  indicator  for 
operation  and  operate  elevation  quad- 
rant. 

8. 

9. 

Prepare  azimuth  indicator  for 
operation. 

Operate  elevation  quadrant. 

5.  Boresight  gunner's  telescope. 

10. 

Boresight  telescope. 

6.  Boresight  daylight  sight  and  IR 
sight  of  gunner's  periscope  during 
daylight. 

11. 

12. 

Boresight  daylight  periscope. 

Boresight  IR  periscope  during 
daylight. 

7.  Boresight  the  M219  machinegun. 

14. 

Boresight  the  M219  machinegun. 

8.  Zero  the  main  gun. 

15. 

Zero  the  rain  gun. 

9.  Zero  the  M219  machinegun. 

16. 

Zero  the  M219  machinegun. 

10.  Respond  correctly  to  tank 
contender's  fire  carmands,  including 
actions  in  train  gun  engagements  and 

17. 

Main  gun  engagement — gunner 
fires  from  a stationary  tank 
at  a stationary  target. 

coax  engagements. 

18. 

Main  gun  engagement — gunner  fire 
from  a tank  moving  to  a halt  at 

19. 


20. 


a moving  target. 

Coaxial  machinegun  engagement — 
gunner  fires  from  a moving  tank 
at  a stationary  target. 

Main  gun  engagement — gunner  fires 
from  a tank  moving  to  a halt  at 
a stationary  target. 
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Table  1 . Correspondence  Between  Readiness  Tests 
and  Canpcsite  Criterion  Task  Groups  (cant'd.) 


[ 


GUNNER  TASKS  (cant'd.) 


Task  Group 


Readiness  Test  Items 


11.  Apply  immediate  action  in  case  21.  Apply  immediate  action  in  the 

of  main  gun  failure  to  fire  (misfire)  case  of  a misfire. 

and  unload  misfired  main  gun.  22.  UnlsXLd  ^in  gun. 

Read-iness  Test  Items  not  included  in  Task  Groups. 

1.  Check  operation  of  M3  heater. 

2.  Charge  manual  elevation  system. 

3.  Place  turret  into  power  operation. 

5.  Prepare  tank  for  boresighting. 

13.  Boresight  the  searchlight  using  the  alternate  method. 

23.  Acquire  targets. 

TANK  OOM4ANDER  TASKS 


1.  Perform  main  gun  prepare- to- 
fire  procedures  from  the  TC  position. 


2.  Perform  prepare- to-f ire  proce- 
dures. 


2.  On  the  M85  machinegun,  dismount 
from  tank,  disassemble,  assemble, 
and  mount  on  tank. 


4.  Dismount  M85  machinegun. 

5.  Disassemble  M85  machinegun. 

7.  Maintain,  clean,  and  inspect 
M85  in  preparation  for  firing. 

8.  Assemble  M85  machinegun. 


3.  Load  and  clear  MBS  machinegun. 


3.  Load  and  clear  M85  machinegun. 


4.  ffaintain,  clean,  and  inspect  M85  6.  Maintain,  clean,  and  inspect 

in  preparation  far  firing  and  after  M85  after  firing, 

firing. 


5.  Perform  TC  duties  to  prepare 
rangefinder  for  operation. 


11.  Prepare  rangefinder  for  operation. 


Table  1.  Correspondence  Between  Readiness  Tests 
and  Corposite  Criterion  Task  Groups  (cont'd.) 


TANK  CCM4ANDER  TASKS  (cont'd.) 


T^sk  Group 


Readiness  Test  Items 


6.  Determine  range  to  target  with  12.  Determine  range  to  target  with 


rangefinder. 


7.  Boresight  rangefinder. 


8.  Boresight  M85  Machinegun. 


9.  Zero  the  main  gun,  the  M219 
machinegun,  and  the  M85  rachinegun. 


10.  Announce  fire  oomrands  far 
different  types  of  engagements  inclu- 
ding main  gun,  M219  machinegun,  and 
M85  machinegun. 


rangefinder. 


13.  Boresight  rangefinder. 


15.  Boresight  M85  machinegun. 


16.  Zero  rain  gun. 

17.  Zero  M2 19  machinegun. 

18.  Zero  M85  machinegun. 


20.  Main  gun  engagement — tank  ocrrman- 
der  fires  while  moving  to  a halt 
at  a stationary  target. 

21.  Main  gun  engagement — gunner  fires 
while  tank  is  stationary  at  a 
stationary  target. 

22.  Main  gun  engagement— gunner  fires 
while  tank  is  moving  to  a halt 
at  a moving  target. 

23.  Coaxial  machinegun  engagement — 
tank  ccmnander  fires  from  a 
moving  tank  at  a moving  target. 

24.  Coaxial  machinegun  engagement — 
gunner  fires  from  a moving  tank 
at  a stationary  target. 

25.  Caliber  .50  engagement — tank 
ccmnander  fires  while  moving  to 
a halt  at  a moving  target. 

26.  Main  gun  engagement— gunner  fires 
while  moving  to  a halt  at  a 
stationary  target. 


i 


Table  1.  Correspondence  Between  Readiness  Tests 
and  Conposite  Criterion  Task  Groups  (cont'd. ) 


Readiness  Test  Items  not  included  in  Task 


1.  Check  operation  of  M3  heater. 

9.  Mount  M85  machinegun. 

10.  Prepare  tank  for  boresighting . 

14.  Boresight  searchlight  using  the  alternate  method 
19.  Acquire  targets. 


Table  2 . Descriptive  Data:  Readiness  Test  Performance 


DRIVER  LOADER 


Performance 
Test 1  2 

Test 
n = 42 

Retest 
n = 13 

Test 
n * 35 

Retest 
n = 6 

X 

SD 

X 

SD 

X 

SD 

X 

1 

.69 

.35 

.60 

.40 

• 803 

.37 

— 

2 

.83 

.20 

.66 

.30 

.64 

.44 

.82 

3 

.84 

.27 

.62 

.33 

.82 

.31 

.98 

4 

.89 

.12 

.61 

.19 

.65 

.39 

.65 

5 

.93 

.14 

.53 

.32 

.80 

.35 

.93 

6 

— 

— 

.69 

.40 

.93 

7 

— 

— 

.63 

.40 

.63 

8 

— 

— 

.79 

.34 

.97 

9 

— 

— 

.79 

.39 

.95 

10 

11 

— 

— 

• 

— 

— 

GUNNER 

TANK  CCM4ANDER 

Performance 

Test 

Retest 

Test 

Retest 

Test 

n 

= 49 

n 5 

19 

n = 

44 

n = 23 

X 

SD 

X 

SD 

X 

SD 

X 

1 

.86 

.22 

.41 

.34 

.87 

.21 

.74 

2 

.74 

.33 

.33 

.31 

.95 

.16 

.89 

3 

.90 

.17 

.45 

.33 

.98 

.06 

.92 

4 

.76 

.29 

.29 

.25 

.94 

.22 

.91 

5 

.83 

.29 

.57 

.32 

.92 

.21 

.89 

6 

.79 

.31 

.40 

.30 

.99 

.04 

1.0 

7 

.94 

.25 

.55 

.44 

.93 

.23 

.83 

8 

.90 

.21 

.66 

.29 

.95 

.17 

.93 

9 

.87 

.22 

.51 

.37 

.96 

.13 

.82 

10 

.95 

.07 

.88 

.13 

.97 

.05 

.87 

11 

.89 

.18 

.93 

.18 

- 

— 

— 

1.  Scares  are  proportion  of  steps  correct  for  each  task  group. 

2.  Group  numbers  correspond  to  the  groups  listed  in  Ihble  1. 

3.  N for  this  test  = 19. 
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performance  index  rather  than  the  "task  GO/NO  GO"  measure, 
for  the  basic  reason  that  the  latter  measure  would  give 
differential  weights  to  individual  items.  For  example,  the 
adoption  of  a GO/NO  GO  rule  for  the  task  groups  would  require 
that  an  entire  group  of,  say,  six  items  would  be  scored  as 
NO  GO  if  only  one  item  were  failed.  The  same  group  NO  GO  score 
would  be  assigned  to  a group  consisting  of  only  one  item. 
Furthermore,  the  proportion  of  steps  passed  measure,  since  it 
has  a higher  number  of  potential  values,  is  more  likely  to 
demonstrate  substantial  variability  than  any  GO/NO  GO  rule. 
Therefore,  for  each  composite  task  group,  a proportion-of- steps- 
passed  score  was  computed  by  dividing  the  number  of  steps 
passed  in  the  group  by  the  total  number  of  steps  taken  in  the 
group. 

As  mentioned  above,  given  these  new  task  groupings,  it  was 
necessary  to  recalculate  the  recency  and  frequency  variables. 

[it  should  be  noted  that  the  recency  variable  was  measured 
along  a six-point  scale  ranging  from  no  practice  (0)  to  most 
recently  practiced  within  the  last  two  months  (5),  and  the 
frequency  variable  was  measured  along  a four-point  scale 
ranging  from  no  practice  in  the  past  year  (0)  to  10  or  more 
times  in  the  past  year  (3).]  Table  3 shows  the  mean  recency 
and  frequency  of  practice  for  each  of  the  task  groups.  These 
numbers  were  computed  by  summing  the  ratings  for  all  tasks  in 
a given  group  and  dividing  by  the  number  of  tasks  in  each. 

Thus,  the  values  presented  in  the  table  are  comparable  to  the 
data  presented  in  the  previous  Technical  Report. 

Additional  Criterion  (Performance)  Data 

As  remarked  previously,  the  Readiness  Test  employed  in 
this  study  is  a relatively  new  instrument  and  has  not  been 
studied  or  evaluated  in  detail.  The  unsystematic  relationships 
found  in  Phase  I might  have  been  partially  due  to  the  novelty 
of  the  test  from  the  perspective  of  the  test  administrators, 
inconsistent  interpretations  of  the  scoring  rules,  inadequacy 
of  instructions,  or  a host  of  other  factors  influencing  the 
test  administration.  Therefore,  in  an  effort  to  clarify  some 
of  these  potentially  biasing  influences,  the  decision  was  made 
to  incorporate  additional  performance  data  into  the  data  set. 

Two  types  of  information  were  made  available:  the  results 
from  a readministration  of  the  Readiness  Test  to  a subset  of 
the  troops,  and  the  Skill  Qualification  Test  (SQT)  scores  from 
many  of  the  soldiers  involved  in  the  Phase  I data  collection. 
Given  these  additional  data,  several  questions  could  be 
addressed.  For  example,  the  relationship  between  the  first 
and  second  administrations  of  the  Readiness  Test  could  be 
examined  in  order  to  possibly  detect  any  systematic  variations 
in  administration  and  to  provide  an  initial  estimate  of  the 
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Table  3 . Descriptive  Data:  Recency  and  Frequency  of 
Performance  for  Ocnposite  Task  Groups 

Driver  loader  Gunner  T.  Ccmrander 

Task  Group*  n = 42  n = 42  n : 51  n ; 44 

Recency 


X 

SD 

X 

SD 

X 

SD 

X 

SD 

1 

2.79 

2.00 

3.14 

0.33 

4.06 

1.66 

4.29 

1.45 

2 

4.45 

1.11 

1.30 

1.79 

3.98 

1.79 

4.00 

1.33 

3 

2.98 

2.27 

2.29 

2.24 

3.98 

1.81 

3.07 

2.05 

4 

3.62 

1.61 

2.44 

2.25 

3.69 

1.76 

3.44 

1.96 

5 

2.42 

1.72 

1.43 

1.75 

3.76 

1.96 

4.24 

1.71 

6 

— 

1.41 

1.90 

2.71 

1.68 

4.64 

1.16 

7 

— 

1.33 

1.86 

2.76 

2.07 

3.83 

2.08 

8 

— 

2.95 

1.93 

3.63 

2.00 

2.72 

2.19 

9 

— 

3.37 

2.12 

2.49 

2.18 

3.01 

1.78 

10 

— 

— 

1.84 

1.50 

1.63 

1.68 

11 

— 

1.86 

f 

1.75 

— 

- 

X 

SD 

A.  4 

X 

SD 

f 

X 

SD 

X 

SD 

1 

0.87 

0.72 

1.68 

1.25 

1.76 

1.01 

1.50 

.90 

2 

2.61 

0.77 

.79 

.98 

1.49 

.99 

0.37 

0.83 

3 

1.28 

1.16 

1.31 

1.26 

1.55 

1.05 

1.41 

1.00 

4 

1.81 

0.98 

1.31 

1.14 

1.40 

0.88 

1.52 

.95 

5 

1.20 

0.97 

0.88 

1.10 

1.35 

1.02 

1.55 

.95 

6 

— 

0.63 

0.90 

0.92 

0.78 

1.95 

.99 

7 

— 

.98 

1.20 

1.16 

.95 

1.37 

1.05 

8 

— 

1.50 

1.16 

1.34 

.96 

1.11 

.95 

9 

— 

1.39 

1.07 

1.08 

1.02 

1.02 

0.74 

10 

— 

— 

1.05 

0.98 

1.07 

1.07 

11 

— 

— 

- 

0.79 

0.76 

— 

- 

♦Task  group  numbers  correspond  to  the  groups  listed  in  Table  1 


reliability  of  the  test.  Furthermore,  an  examination  of  the 
interrelationships  among  the  three  criterion  measures  (Readi- 
ness Test  1,  readministration,  and  SQT)  would  supply  informa- 
tion regarding  the  validity  of  the  performance  tests.  Finally, 
the  relationships  among  the  various  criterion  measures  and  the 
various  predictor  variables  could  be  examined  to  further  clarify 
the  nature  of  the  effect  of  congruence  on  performance  effective- 
ness. These  topics  will  be  discussed  in  the  following  sections. 

Readiness  Retest.  A total  of  130  troops  were  administered 
the  Readiness  Test  on  the  second  runthrough.  Of  these  130, 

101  troops  were  contained  in  our  data  file.  Unfortunately, 
only  61  of  these  troops  took  the  retest  in  the  same  crew  posi- 
tion as  in  the  first  administration.  These  61  troops  consisted 
of  13  drivers,  six  loaders,  19  gunners,  and  23  tank  commanders. 
For  these  troops,  descriptive  statistics  were  obtained,  again 
using  a "proportion  of  steps  passed"  scoring  rule.  These  data 
are  shown  in  Table  2,  along  with  the  comparable  first  adminis- 
tration. In  addition,  where  the  number  of  troops  was  suffi- 
cient, correlations  and  paired  t- tests  between  corresponding 
task  groups  were  computed. 

Descriptively,  Table  2 shows  that  the  retest  scores  were 
lower  than  the  first  administration  and,  in  general,  had  higher 
variabilities.  Loaders  are  the  exception  to  this  rule;  however, 
since  there  were  so  few  loaders,  it  is  clearly  inappropriate 
to  consider  this  group  as  representative  of  loader  performance 
in  general.  Thus,  the  loader  group  retest  data  were  excluded 
from  further  analyses.  In  fact,  of  the  26  remaining  tasks 
(excluding  the  loaders),  the  retest  means  for  15  were  signifi- 
cantly lower  (two-tailed  t-test;  p < .05)  and  nine  others  were 
lower  (but  not  significantly  so) . One  of  the  two  remaining 
tasks  (Tank  Commander  Task  Group  6)  was  virtually  identical 
for  the  two  administrations,  and  the  final  task  (Gunner  Task 
Group  11)  was  nonsignif icantly  higher  on  the  retest.  Similarly, 
20  of  the  25  tasks  (Tank  Commander  Task  Group  6 had  no  variance) 
showed  increases  in  variance  on  the  retest. 

Correlations  between  the  first  and  second  administrations 
were  uniformly  low  for  all  task  groups.  In  fact,  only  one 
task  (Tank  Commander  Task  Group  7)  showed  a significant 
(p  < .05)  test-retest  correlation.  In  an  attempt  to  explicate 
this  unexpected  finding,  bivariate  scatterplots  of  the  two 
administrations  were  created  for  each  task  group.  These  plots 
revealed  that  the  low  correlations  were  primarily  caused  by 
a few  extreme  values:  the  general  pattern  was  tor  a few  troops 
who  had  performed  very  well  on  the  first  administration  to 
score  extremely  low  on  the  retest.  Statistically,  it  is  the 
case  that  outliers  (points  far  from  the  mean)  affect  variance 
and  regression  weights  (i.e.,  correlations)  more  than  those 
near  the  mean.  Combined  with  the  small  sample  size,  those 
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few  extreme  values  acted  to  substantially  lower  the  obtained 
correlation  coefficients.  Discussion  of  the  implications  of 
these  results  for  the  possible  biases  in  administration  and 
Readiness  Test  reliability  will  be  postponed  until  further 
data  (the  wi thin-test  correlations)  are  presented  below. 

SQT  Performance.  Selected  SQT  data  were  available  for 
137  troops  involved  in  this  study:  23  drivers,  24  loaders,  51 
gunners,  and  39  tank  commanders.  There  were  three  SQT  skill 
level  tests  administered  (corresponding  to  Skill  Levels  2,  3, 
and  4).  Given  the  fact  that  for  purposes  of  this  study  some 
troops  were  "out  of  position",  the  mapping  of  crew  positions 
onto  SQT  level  was  not  isomorphic.  Thus,  all  23  drivers,  took 
SQT  2;  20  loaders  took  SQT  2,  2 took  SQT  3 and  2 took  SQT  4; 

45  gunners  took  SQT  2 and  6 took  SQT  3;  12  tank  commanders  took 
SQT  2,  13  took  SQT  3,  and  14  took  SQT  4.  Three  scores  were 
available  for  SQT  2 and  3:  the  number  of  NO  GO  tasks  for  the 
hands-on  component  (SQT-T) , the  number  of  NO  GO  tasks  for  the 
written  component  (SQT-W) , and,  for  some  of  the  troops,  the 
number  of  items  (within  tasks)  NO  GO  for  the  hands-on  compo- 
nents (SQT- I ) . Since  the  SQT  4 test  is  entirely  written, 
there  are  no  SQT-4T  or  SQT- 4 I scores. 

Descriptive  data  for  these  test  scores  are  shown  in  Table 
4.  Although  possibly  not  germane  to  this  project,  a number 
of  aspects  of  this  table  warrant  attention.  First,  practically 
all  troops  performed  remarkably  well  on  the  hands-on  compo- 
nents of  whichever  SQT  they  took.  This  is  probably  due  to 
the  extensive  preparation  typically  undergone  for  these  career- 
relevant tests.  On  the  other  hand,  performance  on  the  written 
components  of  all  SQT's  was  surprisingly  low,  with  most  troops 
failing  almost  half  the  tasks.  Apparently,  troops  cannot 
prepare  as  extensively  for  the  written  items  as  they  can  for 
the  hands-on  items,  even  though  the  SQT  Notices  describe  the 
written  tasks  in  some  detail.  The  issue  of  preparation  for 
performance  testing  should  be  kept  in  mind  when  viewing  the 
Readiness  Test  data;  it  was  assumed  that  (at  least  for  the 
first  administration)  troops  were  tested  "cold":  that  is, 
without  the  benefit  of  specific  preparation  for  the  test. 

Discussion  of  the  interrelationships  among  the  criterion 
performance  data  will  be  postponed  until  the  remaining  data 
set,  the  confidence  estimates,  is  presented. 

Confidence  Estimates.  The  final  information  which  was 
incorporated  into  the  data  set  was  the  aforementioned  confi- 
dence estimates.  Each  soldier  was  asked  to  rate  his  ability 
[on  a scale  of  one  ("can't  perform  at  all")  to  four  ("can 
perform  very  well")]  to  perform  each  of  the  criterion  task 
groups.  These  ratings  are  presented  descriptively  in  Table  5 
for  each  position.  As  can  be  seen,  confidence  estimates  tended 
to  be  lower  for  the  two  junior  positions  (driver  and  loader) ; 
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Table  5.  Descriptive  Data:  Confidence  Estimates 


Task  Group*  Driver  Loader  Gunner  T.  Germander 

n = 43  n = 40  n = 50  n = 44 


X 

SD 

X 

SD 

X 

SD 

X 

SD 

1 

2.26 

1.11 

2.95 

1.11 

3.04 

.87 

2.84 

.78 

2 

3.33 

.89 

2.52 

1.06 

3.02 

.74 

3.27 

.66 

3 

2.51 

1.12 

3.07 

1.21 

3.02 

.75 

3.25 

.84 

4 

2.88 

1.16 

2.77 

1.21 

3.02 

.89 

3.20 

.70 

5 

2.49 

1.08 

2.82 

1.20 

3.24 

.80 

2.86 

.85 

6 

— 

2.95 

1.15 

2.55 

1.08 

3.32 

.83 

7 

— 

2.62 

1.13 

2.88 

.44 

2.93 

.95 

8 

— 

2.72 

1.20 

3.40 

.78 

2.91 

.86 

9 

— 

3.05 

1.01 

2.88 

.96 

3.14 

.82 

10 

— 

— 

3.24 

.94 

3.23 

.68 

11 

— 

— 

3.46 

.71 

— 

*Task  group  numbers  correspond  to  the  groups  listed  in  Table  1 


these  two  positions  also  tended  to  have  more  variability  in 
their  estimates  than  did  the  two  senior  positions. 

It  will  be  recalled  that  these  confidence  estimates  could 
potentially  be  valuable  as  surrogate  criterion  variables;  that 
is,  if  it  could  be  argued  or  demonstrated  that  these  estimates 
are  related  to  actual  performance,  they  could  be  used  as  - 
"purer"  (uncontaminated  by  specific  test  factors)  criterion 
variables.  In  order  to  assess  the  value  of  the  confidence 
ratings,  two  pieces  of  information  will  be  presented.  First, 
the  within-criterion  intercorrelations,  and  second,  the  zero- 
order  correlations  between  the  confidence  estimates  and  perfor- 
mance test  scores  will  be  shown. 

Criterion  Task  Intercorrelations.  The  purpose  for  this 
analysis  is  to  determine  two  features  of  the  criterion  task 
set.  First,  is  the  internal  consistency  of  each  criterion 
set.  This  feature  could  presumably  reveal  any  "bad"  items 
(analogous  to  item  analyses  in  standard  test  construction) 
or,  if  the  pattern  of  internal  correlations  differed  for  two 
presumably  equivalent  test  forms,  any  systematic  biases  in 
test  administration.  The  second  feature  is  the  between-measures 
relationships  (e.g.,  the  relationship  between  Readiness  Test 
scores  and  SQT  scores) . 

Data  pertaining  to  the  internal  consistency  issue  are  pre- 
sented in  Table  6.  This  table  shows  the  within-test  inter- 
correlations for  the  task  groups  for  each  crew  position.  The 
most  striking  feature  of  this  table  is  that  for  confidence 
estimates,  with  minor  exceptions,  all  of  these  intercorrela- 
tions are  highly  significant  (p  < TUT)  for  all  crew  positions. 

It  would  appear  that  these  troops  do  not  discriminate  among 
the  task  groups  when  they  rate  their  own  ability;  if  a soldier 
judged  that  he  was  good  or  poor  for  one  task,  he  judged  that 
he  was  good  or  poor  for  all  the  others.  This  could  be  a func- 
tion of  the  "completeness"  of  training  for  these  positions 
and  the  perhaps  restricted  range  of  tasks  sampled.  That  is, 
if  a soldier  received  training  or  practice  in  (for  example) 
driving,  the  tasks  presented  for  ratings  constitute  a minimum, 
necessary,  set.  Similarly,  if  a loader  knows  "how  to  load", 
the  nine  task  groups  presented  are  those  uniformly  included 
in  training.  Another  less  likely  explanation  is  that  by 
collapsing  tasks  into  groups,  we  have  unknowingly  created 
groups  that  are  inconsistent  with  the  troops'  view  of  their 
job  or  how  their  job  training  and  practice  is  organized.  For 
example,  the  organization  of  gunner  task  groups  (see  Table  1) 
is  primarily  an  "equipment"  organization,  with  individual 
groups  for  operation  of  the  periscope,  machinegun,  and  tele- 
scope. If,  however,  the  "true"  organization  of  gunner's 
training  or  practice  is  functional  (for  example,  a training 
unit  or  work  detail  is  "general  maintenance"  where  the  gunner 
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rearson  proctuct-nonent  r’s  rounded  to  nearest  hundredth;  decimals  emitted.  Correlations  with 
significance  levels  _<  .01  are  indicated  by  toldfaoe;  correlations  in  italics  are  nonsignificant 

Task  group  ranters  correspond  to  the  groups  listed  in  Table  1. 


Retest  5 — 61  52  83  71  IS  29  Retest 


services  all  of  these  pieces  of  equipment) , gunners  would 
necessarily  give  the  same  confidence  rating  across  our  groups. 
[The  one  task  group  that  does  not  have  uniformly  high  correla- 
tions is  Tank  Commander  Group  2,  which  is  assembly,  disassem- 
bly, and  mounting  of  the  M85  machinegun.  It  is  difficult  to 
argue  from  this  single  exception,  but  it  seems  that  this  case 
indicates  that  tank  commanders  were  able  to  discriminate  this 
task  from  the  others;  hence,  they  were  not  treating  these 
confidence  estimates  as  a single,  uniform  measure  of  their 
ability. ] 

The  intercorrelations  among  the  Readiness  Test  tasks  are 
likewise  predominantly  significant  (p  < .01),  with  tank  comman- 
ders as  an  exception.  This  exception  is  most  probably  due  to 
a ceiling  effect,  as  there  was  insufficient  variance  in  tank 
commander  performance  to  allow  for  significant  correlations 
(see  Table  2).  The  tank  commander  correlations  that  are  sig- 
nificant do,  however,  follow  a somewhat  logical  pattern:  task 
groups  2,  4,  and  8 (which  significantly  intercorrelate)  are  all 
concerned  with  servicing  the  M85,  while  task  groups  1,  3,  5, 
and  7 (which  likewise  intercorrelate  significantly)  can  all  be 
interpreted  as  combat  preparation  tasks. 

For  the  other  crew  positions,  the  uniformly  high  inter- 
correlations support  the  same  sorts  of  speculations  made  con- 
cerning the  confidence  ratings:  the  Readiness  Test  does  not 
seem  to  discriminate  among  the  task  groups.  [Most  of  the 
exceptions  (e.g.,  Gunner  Task  10)  are  probably  due  to  lack  of 
variance  in  the  performance  data.]  This  was  essentially  what 
was  previously  found  when  a similar  analysis  was  performed 
during  Phase  I (see  Table  7 of  the  previous  Technical  Report) . 
In  one  sense,  these  uniformly  high  intercorrelations  are 
disappointing;  it  was  hoped  that  the  restructuring  of  the  test 
items  would  lead  to  measures  of  different  aspects  of  perfor- 
mance. These  hoped-for  differences  could  then  presumably  have 
different  correlates  in  the  predictor  variable  set.  Similarly, 
the  uniformly  high  correlations  do  not  provide  useful  informa- 
tion regarding  specific  items  or  biases  in  test  administration. 
Based  on  these  data,  it  is  still  possible  that  either  the 
Readiness  Test  is  a completely  homogeneous  sampling  of  tank 
crew  skills,  or  that  test  administrators  formed  a generalized 
opinion  about  each  soldier  (e.g.,  deciding  that  the  soldier 
was  a good  gunner) , and  scored  the  entire  test  based  on  this 
generalized  opinion,  or  that  existing  tank  training  precisely 
fits  performance  requirements  (e.g.,  more  training  and  prac- 
tice are  provided  for  more  difficult  tasks). 

The  intercorrelations  for  the  Readiness  Retest  add  some 
confusion  to  the  above  speculations.  For  example,  the  inter- 
correlations for  drivers  are  all  nonsignificant.  This,  of 
course,  might  be  due  to  the  small  N's  in  these  computations 
(since  the  absolute  values  are  relatively  high);  or,  if  viewed 
in  isolation,  this  result  could  be  interpreted  as  independent 
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tests  of  driver's  skills.  This  latter  interpretation  is 
clearly  inconsistent  with  previous  results,  and  thus  leads  to 
the  suspicion  that  the  retest  was  somehow  different  from  the 
first  administration  (at  least  for  drivers) . Given  that  per- 
formance on  the  retest  was  lower  than  on  the  first  administration 
(see  Table  2)  , it  is  possible  that  the  retest  was  a more  accu- 
rate reflection  of  driver  performance.  However,  there  is 
simply  no  confirmatory  evidence  for  this  hypothesis,  especially 
given  the  previous  discussion  of  test-retest  relationships. 

Within-test  correlations  for  the  SQT  tests  suffer  from 
the  problem  of  small  N's.  Nevertheless,  some  of  these  corre- 
lations were  significant  (p  < .01):  for  drivers,  SQT  2T  was 
related  to  SQT  21  (r  = .88,  N * 15),  and  SQT  2W  (r  = .48, 

N = 15);  for  loaders,  SQT  21  was  related  to  SQT  2T  (r  = .90, 

N = 20);  for  gunners,  SQT  21  was  related  to  SQT  2T  (r  = .86, 

N = 30)  and  SQT  2W  (r  = .43,  N = 30);  and  for  tank  commanders, 

SQT  21  was  related  to  SQT  2T  (r  = .93,  N = 8)  and  SQT  3T  was 
related  to  SQT  3W  (r  = .63,  N = 6)  . Thus,  in  all  cases  where 
a computation  was  possible,  the  two  hands-on  scores  were 
related  to  each  other,  while  the  relationships  between  the 
hands-on  components  and  the  written  components  were  less  obvious. 

The  final  issue  to  be  discussed  is  the  interrelationships 
among  the  criterion  measures.  Some  of  these  have  been  dis- 
cussed previously,  namely  the  Readiness  Test-Retest  relation- 
ship. The  other  comparisons — SQT  vs.  Readiness  Test,  Confidence 
Ratings  vs.  Readiness  Test,  Retest,  and  SQT,  will  be  discussed 
below.  [SQT  vs.  Retest  correlations  were  calculated  just  for 
gunners  due  to  the  small  number  of  troops  in  the  other  posi- 
tions for  which  both  scores  were  available.] 

SQT  vs.  Readiness  Test.  Although  this  is  a critical  com- 
parison  in  terms  of  assessing  the  value  of  the  Readiness  Test 
as  a valid  measure  of  combat  effectiveness,  such  a comparison 
must  be  viewed  with  extreme  caution.  Troops,  in  general,  have 
extensive  training  for  the  SQT.  They  are  issued  SQT  notices 
which  describe  exactly  what  they  will  be  tested  on,  training 
for  the  test  is  typically  an  organized  activity  at  the  Company 
level,  and  SQT  scores  have  a significant  impact  upon  a soldier's 
career  progression.  On  the  other  hand,  the  Readiness  Test  was 
administered  with  little  or  no  preparation  on  the  part  of  the 
troops — they  did  not  know  what  they  would  be  tested  on  prior 
to  administration.  Furthermore,  the  troops  knew  that  their 
performance  would  not  have  any  impact  on  their  careers.  Given 
these  considerations,  it  is  not  surprising  that  SQT  perfor- 
mance uniformly  did  not  correlate  with  test  performance.  The 
only  exceptions  were  three  significant  correlations  between 
SQT  2W  and  the  Retest  task  groups  8,  9,  and  10  for  gunners 
(where  N = 18) . In  one  sense,  this  lack  of  a relationship 
could  be  viewed  as  a severe  criticism  of  the  tank  training 
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system:  in  essence,  the  argument  would  be  that  in  order  to 
meet  the  established  standards  of  performance  (i.e.,  the  SQT) , 
troops  must  be  given  extensive  preparation;  there  is  no  corres- 
pondence between  their  performance  if  sampled  without  such 
preparation  and  "true"  (SQT)  measures  of  combat  effectiveness. 
However,  such  a sweeping  generalization  is  clearly  inappropriate: 
first,  as  we  have  seen.  Readiness  Test  performance  is  (on  an 
absolute  scale) , quite  good,  especially  when  one  considers  the 
lack  of  preparation.  Second,  there  is  no  a priori  relation- 
ship between  the  content  of  the  two  tests.  [Such  a mapping 
was  attempted,  based  on  both  the  task  communality  of  the  two 
tests  and  on  the  basis  of  a step-by-step  comparison  of  tasks 
that  were  in  common.  Especially  in  the  latter  comparison,  the 
lack  of  correspondence  led  to  the  conclusion  that  the  tests 
were  clearly  different  in  content.]  And  finally,  there  is  no 
evidence  that  minimum  acceptable  preparation  (as  would  be  the 
case  in  a combat  environment)  for  the  Readiness  Test  would  not 
have  produced  more  significant  relationships. 

Confidence  vs.  Performance  Tests.  Correlations  bearing 
upon  these  comparisons  are  shown  in  Table  7 as  a function  of 
crew  position.  Considering  SQT  performance  first,  the  only 
significant  relationships  appear  for  the  SQT  2W  scores  for 
gunners.  [The  negative  signs  are  in  the  "right"  direction, 
since  the  SQT  scores  are  number  of  items  failed. ] The  same 
arguments  made  above  concerning  the  SQT-Readiness  Test  rela- 
tionships apply  here  as  well;  the  most  parsimonious  explanation 
is  that  the  two  sets  of  data  measure  different  things.  It 
would  have  been  interesting  if  soldiers  had  been  asked  to  rate 
their  confidence  in  their  ability  to  perform  the  individual 
SQT  items. 

In  general,  there  are  significant  relationships  between 
confidence  estimates  and  Readiness  Test  performance  for  loaders. 
The  uniform  nature  of  these  significant  correlations,  rather 
than  a strictly  diagonal  form,  reinforces  the  notion  that  both 
the  confidence  ratings  and  performance  tests  do  not  discrimi- 
nate among  the  reconstituted  task  groups.  There  is  a sugges- 
tion of  a more  direct  correspondence  for  drivers:  at  least 
for  two  task  groups  (numbers  1 and  5) , significant  correlations 
were  obtained  between  confidence  estimates  and  Readiness  Test 
performance.  However,  the  general  lack  of  significant  relation- 
ships for  the  other  positions  is  somewhat  disappointing.  It 
would  be  hard  to  argue  that  soldiers  accurately  estimated 
their  performance  capabilities.  However,  it  should  be  noted 
that  the  soldiers  were  not  provided  with  detailed  descriptions 
of  the  tasks;  thus,  it  might  be  that  the  actual  Readiness  Test 
items  were  different  from  the  way  soldiers  conceptualized  them. 
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Table  7.  Zero-Order  Validity  Between  Confidence  Estimates 
and  Performance  Test  Scores  and  SQT  Scores 


N's  for  loader  retests  were  insufficient  to  ccnpute  correlations  (see  text) 
N = 17  for  task  qroLfi  l;  H k 31  for  the  remaining  task  grcx^s. 

N = 13  for  21;  N = 18  for  2T  and  2W. 
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In  summary,  these  data  do  not  support  the  contention  that 
confidence  estimates  could  be  used  as  a direct  surrogate  of 
Readiness  Test  performance.  However,  there  is  good  support 
(based  on  their  internal  consistency  and  the  unsolved  ques- 
tions of  the  validity  and  reliability  of  the  Readiness  Tests 
themselves)  for  the  retention  of  these  estimates  as  a quasi- 
independent criterion  measure.  If  meaningful  predictions  could 
be  made  of  this  measure  from  the  predictor  variables,  the  basic 
relationship  between  congruence  and  performance  would  be  clari- 
fied. 


CONGRUENCE  EFFECTS 


The  relationships  between  levels  of  job  congruence  and 
effectiveness  on  combat-related  tasks  were  investigated  by 
means  of  two  different  strategies.  First,  as  in  the  Phase  I 
analysis  of  the  smaller  set  of  criterion  tasks,  zero-order 
validities  were  estimated.  These  estimates  were  obtained  by 
computing  the  correlations  between  the  background,  congruence, 
and  practice  variables  and  the  various  criterion  measures  of 
performance  effectiveness.  At  issue  was  whether  those  con- 
gruence and  background  variables  related  to  effectiveness 
measures  would  generally  remain  the  same  across  tasks  and  crew 
positions. 

In  the  second  or  "case  study"  approach,  judges  assigned 
subjects  to  different  categories  representing  varying  levels 
of  presumed  job  congruence.  Assignments  were  made  by  consider- 
ing and  subjectively  weighting  a small  subset  of  the  variables 
describing  each  soldier's  background  and  job  congruence.  For 
each  criterion  task,  the  categories  of  soldiers  were  ranked 
to  represent  predicted  levels  of  effectiveness.  The  strength 
of  the  relationships  between  congruence  and  effectiveness  were 
explored  by  analyzing  the  resulting  contingency  tables.  This 
approach  essentially  replaced  the  "best  subsets"  multiple 
regression  analyses  conducted  in  Phase  I,  which  were  difficult 
to  interpret  and  were  based  on  a fairly  large  number  of  inde- 
pendent variables  relative  to  the  rather  small  sample  sizes 
on  which  data  were  available. 

Zero-Order  Validities 


The  relationships  between  the  independent  and  criterion 
variables  were  examined  separately  for  each  of  the  four  crew 
positions.  In  each  case  the  personal  background,  Army  and 
job  background,  congruence,  and  practice  variables  were  corre- 
lated with  a variety  of  criterion  effectiveness  measures.  The 
latter  included  estimates  of  effectiveness  for  each  composite 
criterion  task  (i.e.,  proportion  of  steps  passed  and  confidence 
ratings)  as  well  as  summary  performance  measures  relating  to 
the  readiness  tests  (i.e.,  proportion  of  steps  passed,  and 
proportion  of  tasks  on  which  a GO  was  received)  and  to  Skill 
Qualification  Tests.  The  results  are  presented  below  for 
each  crew  position. 

Drivers.  Significant  (p  < .01)  zero  order  validities 
were,  with  but  two  exceptions,  confined  to  the  first  composite 
task  dealing  with  maintenance  and  services  on  the  periscopes. 
The  two  exceptions  are  a negative  relationship  between  height 
and  tactical  driving  performance  (Task  4,  r = .41,  p < .01) 
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and  a positive  correlation  between  months  in  position  during 
the  past  year  and  starting  the  engine  (Task  2,  r = .44,  p < .01). 

As  shown  in  Table  8,  the  strongest  relationships  with 
performance  on  Task  1 involve  variables  primarily  from  the  Army 
and  job  background  and  the  congruence  categories.  Better 
performance  is  associated  with  soldiers  who  have  been  in  crews 
for  longer  periods  of  time,  have  served  in  more  crew  positions 
during  training,  and  have  participated  in  more  Table  VIIIs. 

The  fact  that  they  have  participated  in  training  programs  and 
Table  VIIIs  specifically  as  drivers  is  important.  Also  asso- 
ciated with  better  performance  is  frequent  practice  of  this 
task,  as  well  as  Task  2 (starting  the  engine) , longer  time  in 
the  HE  primary  MOS,  and  the  stated  intention  to  reenlist. 

» 

These  relationships  appear  generally  consistent  and  logi- 
cal given  that  this  composite  task  (of  the  five  tested)  is  in 
fact  performed  least  frequently,  the  one  on  which  soldiers 
achieve  the  lowest  mean  performance,  and  relative  to  the  other 
four,  is  the  one  possessing  the  largest  variance.  The  same 
types  of  relationships  between  the  independent  variables  and 
performance  on  Task  1 are  essentially  mirrored  in  the  overall 
proportion-of-steps-passed  measure  (HOP)  based  on  all  five 
composite  tasks. 

The  absence  of  similar  relationships  for  the  other  driver 
tasks  may  be  essentially  due  to  reasonably  high  congruence. 

These  tasks  are  practiced  more  frequently,  performanpe  is 
higher  (ranging  from  a mean  of  .83  to  .93),  and  there  is  rela- 
tively little  variance  in  the  test  scores  (SD  ranging  from 
.12  to  .27).  Roughly  two-thirds  of  the  sample  are  in  fact 
drivers  who,  during  their  average  ten-and-a-half  months  in 
that  position,  have  been  able  to  practice  these  tasks  fairly 
frequently  (more  so  than  the  periscope  task) . 

u 

No  significant  (p  < .01)  zero-order  validities  are 
associated  with  the  retest  performance  data  subsequently  ob- 
tained for  a rather  small  subset  (n=13)  of  the  original  driver 
sample.  No  significant  relationships  are  obtained  with  the 
overall  proportion-of-tasks-GO  measure.  Finally,  with  respect 
to  SQT  scores,  only  the  soldier's  rank  correlates  signifi- 
cantly with  performances  (r=.61,  p < .01,  for  SQT  21;  r=.48, 
p < .01  for  SQT  2W) . 

I fT 

Relationships  between  the  various  independent  variables 
and  soldiers'  estimates  of  their  ability  to  perform  the  driver 

[criterion  tasks  are  presented  in  Table  9.  The  results  differ 
dramatically  from  those  presented  for  the  readiness  test  per- 
formance measures . 


Table  8.  Zero-Order  Validities*  Between  Background/Congruence/ 
Practice  Variables  and  Proportion  of  Steps  Passed  by 
Drivers  on  the  Periscope  Composite  Task 

(Readiness  Test  Data) 


Personal 

Background 

Weight 

Height 

Age  — 

Education  — 

Like  Job  — 

Reenlist  45 

Army  & Job 
Background 

Months  Served  — 
Rank  — 
Months  in  Primary  MDS  37 
Skill  Level-Primary  MSS  ■ — 
Years  in  Crew  46 
Number  Positions  Held  in  Training  51 
Number  Table  VIIIs  52 

Congruence 

Months  in  Duty  MSS  — 
Skill  Level-Duty  MSS  — 
Test  Position-Job  Title  Match  — 
Position  Training  46 
Position  Table  VIIIs  46 
Months  in  Position  Past  Year  — 
Hours  per  Day  in  Position  — 
Platoon  Sergeant  Ratings  — 

Frequency 

of 

Practice 

Task  1 41 
Task  2 37 
Task  3 — 
Task  4 

Task  5 — 

Recency  of 
Practice 

Task  1 — 
Task  2 

Task  3 — 
Task  4 — 
Task  5 — 

Correlations  rounded  to  the  nearest  hundredth  with  decimal  points  omitted. 
Correlations  with  significance  levels  <_  .001  are  indicated  in  bold  face; 
others  are  significant  in  the  range  _<  .01,  > .001. 


47 


[ 


Table  9.  Zero-Order  Validities*  Between  Background/Oongruence/ 
Practice  Variables  and  Driver  Confidence  Estimates  for 
Five  Ccrposite  Tasks 

TASKS 


Weight 

Height 

Age 

Education 
Like  Job 
Reenlist 


Months  Served 
Rank 

Months  in  Primary  MGS 
Skill  Level-Primary  MSS 
Years  in  Crew 

Number  Positions  Held  in  Training 
Number  Table  VII  Is 


Months  in  Duty  MOS 
Skill  Level-Duty  MGS 
Test  Positicn-Job  Title  Match 
Position  Training 
Position  Table  VIIIs 
Months  in  Position  Past  Year 
Hours  Per  Day  in  Position 
Platoon  Sergeant  Ratings 


Task  1 
Task  2 
Task  3 
Task  4 
Task  5 


Task  1 
Task  2 
Task  3 
Task  4 
Task  5 


Correlations  rounded  to  the  nearest  hundredth  with  decimal  points  omitted. 
Correlations  with  significance  levels  .001  are  indicated  in  bold  face; 
others  are  significant  in  the  range  .01,  > .001. 
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49 
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36 

40 

58 

49 

62 

64 

48 

56 

59 

49 

— 

62 

53 

— 

49 

57 

59 

77 

50 

61 

— 

71 

54 

42 

55 
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46 

— 
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The  caution  that  must  be  sounded  when  inspecting  the 
correlations  shown  in  Table  9 is  in  assuming  that  the  confi- 
dence estimates  are  in  fact  valid  surrogates  of  the  performance 
data.  As  reported  earlier,  there  is  some  evidence  that  the 
two  measures  are  related  in  the  sample  of  drivers,  particu- 
larly with  respect  to  the  periscope  composite  task  (r».58, 
p < .001)  . The  lack  of  particularly  strong  relationships 
between  expressions  of  confidence  and  levels  of  performance 
on  the  other  four  tasks  must  be  tempered  by  the  fact  that 
there  is  such  small  variance  in  the  hands-on  performance 
measures . 


The  more  conservative  line  of  interpretation  addresses 
the  factors  upon  which  drivers  base  their  estimates.  For 
example,  as  shown  in  Table  9,  a driver's  estimate  of  his  abil- 
ity to  perform  a combat-related  composite  task  has  virtually 
nothing  to  do  with  his  personal  background.  Rather,  it  de- 
pends substantially  on  those  background,  congruence,  and  prac- 
tice variables  that  reflect  relevant  experience  such  as: 
years  in  crew,  number  of  crew  positions  held  in  training  pro- 
grams and  Table  VIIIs,  particularly  as  a driver;  months  of 
experience  in  the  position;  and  frequency  and  recency  of  prac- 
tice. While  we  are  reluctant  to  view  these  relationships  as 
indicative  of  those  which  might  have  been  obtained  had  greater 
variance  in  test  scores  been  found,  it  is  interesting  to  note 
that  the  independent  variables  correlating  with  the  Task  1 
performance  criterion  measure  also  correlate  with  the  confi- 
dence estimates. 


Loaders . Zero-order  validities  for  the  performance  data 
on  each  of  nine  loader  composite  tasks  are  presented  in 
Table  10.  Performance  on  the  first  task  (checking  and  adjust- 
ing track  tension)  does  not  correlate  significantly  with  any 
of  the  independent  variables.  Presumably  the  failure  to 
demonstrate  strong  correlates  of  performance  on  this  task  is 
a function  of  the  relatively  small  subset  (n=19)  of  loaders 
who  were  tested  on  it.  On  each  of  the  remaining  eight  loader 
composite  tasks,  background  and  congruence  variables  are  found 
that  do  covary  with  the  proportion-of-steps-passed  measure, 
many  of  them  being  particularly  strong  correlates  of  perform- 
ance . 


As  was  true  for  the  driver  sample,  variables  describing 
the  personal  background  of  loaders  do  not  correlate  signifi- 
cantly with  performance.  Instead,  performance  tends  to  vary 
as  a function  of  such  background  variables  as  skill  level  of 
primary  MOS,  years  in  crew,  and  number  of  positions  held  in 
training  programs.  Among  the  congruence  variables,  those 
that  significantly  correlate  with  performance  on  more  than 
one  task  include  duty  MOS  skill  level,  having  held  the  loader 
position  in  training  programs,  and  hours  per  day  spent  in 


49 


Table  10.  Zero-Order  Validities*  Between  Backgroui^/CXxigruenceA>ractice  Variables 
and  Proportion  of  Steps  Passed  by  loaders  in  Nine  Composite  Tasks 
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Correlations  rounded  to  the  nearest  hundredth  with  decimal  points  omitted. 

Correlations  with  significance  levels  < .001  are  indicated  in  bold  face;  others  are  significant  in  the 
range  < .01,  > .001. 
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loader  activities.  For  the  most  part,  the  recency  and  fre- 
quency with  which  each  task  has  been  practiced  do  not  relate 
to  the  performance  measure  for  that  task,  a finding  consistent 
with  the  general  pattern  of  results  obtained  for  the  driver 
sample.  Retest  data  were  available  for  too  few  loaders  (n  = 6) 
to  determine  whether  these  same  general  patterns  of  validities 
characterized  performance  during  the  second  administration  of 
the  readiness  tests. 

The  large  number  of  correlates  significantly  associated 
with  performance  on  the  individual  loader  composite  tasks  is 
reflected  in  the  summary  performance  measures  as  shown  in 
Table  10.  The  correlates  with  the  overall  proportion-of-steps 
measure  (HOP)  and  the  proportion-of-tasks-GO  measure  (Prop  Go) 
are  many  and  quite  strong,  reflecting  the  positive  relationship 
between  relevant  experience  as  a loader  and  successful  perform- 
ance of  loader  tasks.  The  obtained  correlates  are  presumably 
as  strong  as  they  are  because  job  congruence  is  definitely  an 
issue  among  the  loaders  in  our  sample.  Only  58%  reported 
that  they  were  routinely  functioning  as  loaders,  having  done 
so  for  an  average  of  10.83  months.  With  respect  to  SQT  2 scores , 
the  longer  a loader  has  worked  in  that  position  (Duty  Time) 
the  higher  is  his  hands-on  performance  score  expressed  either 
as  the  number  of  steps  GO  (r=.72,  p < .01)  or  the  number  of 
tasks  GO  (r=.58,  p < .01).  A finding  that  does  not  make  in- 
tuitive sense  is  that  the  hours-per-day  measure  correlates 
negatively  with  SQT  2 performance  expressed  as  the  number  of 
hands-on  tests  on  which  a GO  is  received  (r=-.68,  p < .01). 

An  explanation  for  this  relationship  is  not  readily  apparent. 

Two  other  findings  are  of  interest.  Overall  performance, 
especially  HOP,  correlates  significantly  (p  < .01)  with  re- 
ported frequency  and  recency  of  performance  on  Task  1 (check 
and  adjust  track  tension) , Task  4 (prepare  to  fire  procedures) , 
Task  8 (maintaining  the  machinegun) , and  Task  9 (maintaining 
the  breechblock).  (In  the  latter  two  cases,  the  frequency 
correlates  are  significant  at  p < .018.)  These  four  tasks 
represent  the  spectrum  of  activities  for  which  a loader  is 
responsible.  The  other  five  composites  also  deal  with  either 
main  gun  firing,  or  the  M219  weapon  subsystem.  The  second 
interesting  finding  specific  to  loaders  is  the  number  and  the 
strength  of  the  correlations  with  performance  on  Tasks  6 and 
7.  Both  of  these  represent  emergency  procedures  to  be  carried 
out  in  the  event  of  main  gun  or  machinegun  misfires,  and  un- 
like the  other  tasks,  cannot  be  considered  as  fairly  normal 
or  routine  loader  activities. 

Correlations  between  the  various  independent  variables 
and  loader  confidence  estimates  are  shown  in  Table  11.  As 
in  the  driver  data,  virtually  all  of  the  background,  con- 
gruence, and  practice  variables  reflecting  experience  with 
the  composite  tasks  correlate  significantly  with  estimates  of 
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Table  11.  Zero-Order  Validities*  Between  Background/Ccaigruence/Practice 
Variables  and  Loader  Confidence  Estimates  for  Nine  Composite  Tasks 


W«lght 

Haight 

Aga 

Education 
Lika  Job 
Reenlist 


Msnths  Served 
Rank 

Months  in  Prinery  M3S 
Skill  Level-Primary  MDS 
Years  in  Craw 

Nurber  Positions  Held  in  Training 
Nunber  table  vills 


Months  in  Duty  MOS 
Skill  Laval-Outy  MCS 
Test  Position-Job  Title  fetch 
Position  training 
Position  Table  vills 
Months  in  Position  Past  Year 
Hours  Par  Cay  in  Position 
Platoon  Sergeant  Ratings 


Task  1 
Task  2 
Task  3 
Task  4 
Task  5 
Task  6 

Task  3 
Task  4 


47 

56 

67 

62 

65 

51 

51 

43 

54 

51 

53 

57 

60 

48 

58 

44 

47 

56 

65 

66 

61 

64 

62 

42 

47 

4S 

52 

49 

50 

46 

46 

37 

47 

56 

61 

59 

60 

51 

43 

— 

— 

48 

56 

56 

50 

S3 

48 

— 

— 

— 

43 

48 

JS 

49 

44 

— 

— 

33 

48 

43 

33 

48 

— 

— 

43 

46 

42 

46 

48 

— 

48 

— 

44 

46 

4S 

50 

42 

— 

49 

— 

3 9 

41 

42 

47 

48 

52 

52 

46 

Correlations  rounded  to  the  nearest  hundredth  with  decimal  points  omitted.  Correlations  with 
significance  levels  - .001  are  indicated  m bold  face;  others  are  significant  in  the  rare*  .01, 
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one’s  ability  to  perform  each  task.  Again,  the  personal  back- 
ground variables  are  not  strong  correlates  of  stated  confidence. 
The  earlier  caveat  about  the  confidence  estimates  as  valid 
surrogates  of  performance  must  again  be  voiced.  However,  as 
reported  earlier,  highly  significant  (p  < .01)  correlations 
between  confidence  and  performance  were  obtained  on  five  of 
the  nine  tasks  (#3,  #5,  #6,  #7  and  #9)  and  in  the  other  four 
instances  they  were  significant  at  slightly  lower  levels 
(P  < .05) . 

Gunners.  Zero-order  validities  were  estimated  for  the 
11  different  composite  tasks  that  were  used  to  characterize 
gunner  performance.  With  respect  to  the  proportion-of-steps- 
passed  performance  measure,  there  are  virtually  no  signifi- 
cant relationships  with  variables  representing  personal  back- 
ground, Army  and  job  background,  congruence,  or  frequency  and 
recency  of  practice.  In  the  entire  set  of  473  validity  co- 
efficients, only  eight  are  significant.  One  represents  a 
positive  correlation  between  platoon  sergeant  ratings  and 
performance  on  the  prepare-to-f ire-procedures  task  (Task  1, 
r=.35,  p < .01).  Another  indicates  a negative  relationship 
between  gunner  weight  and  performance  during  preparation  of 
the  telescope  for  operation  (Task  2,  r=-.34,  p < .01).  The 
six  remaining  coefficients  essentially  represent  negative 
relationships  between  frequent  and  recent  practice  on  Task  11 
(main  gun  misfire  procedure)  and  performance  on  periscope 
tasks  (#3  and  #6)  and  a machinegun  task  (#9) . The  alterna- 
tive performance  measures  are  consistent  with  this  same  general 
pattern.  None  of  the  independent  variables  correlates  meaning- 
fully with  the  retest  proportion-of-steps-passed  data,  or  with 
the  overall  proportion-of-tasks-GO  or  HOP  measures.  The 
failure  to  find  significant  correlations  between  Army  and  job 
background  and  congruence  variables  and  performance  is  at  odds 
with  findings  reported  for  drivers  and  loaders. 

While  correlations  between  the  independent  variables  and 
performance  on  the  composite  readiness  tests  are  infrequent 
**  and  haphazard,  those  obtained  when  the  SQT  measures  are  examined 

are  more  consistent.  At  first  glance,  however,  the  obtained 
relationships  are  distinctly  counterintuitive.  Performance 
on  SQT2,  as  measured  by  the  number  of  hands-on  tests  in  which 
a GO  is  received,  is  lower  the  longer  gunners  have  been  members 
of  crews  (r  = -0.36,  n = 43,  p = .009),  the  more  months  they 
have  served  (r  = -.44,  n = 44,  p = .001),  and  the  longer  they  as 
llEs  have  served  in  the  gunner  slot  (r  = -.38,  n = 44,  p = .005). 

One  speculation  about  the  inverse  relationship  between 
experience  and  SQT  performance  derives  from  the  fact  that  87% 
of  the  gunner  sample  is  comprised  of  troops  whose  normal  job 
is  that  of  a gunner.  They  have  been  in  that  position  for  an 
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average  of  10.63  months  and  have  been  in  the  service  and  have 
functioned  in  a tank  crew  for  over  two  years.  As  such  they 
are  relatively  congruent  with  the  gunner's  job,  a possibility 
that  may  be  reflected  by  their  high  levels  of  readiness  test 
performance  (means  range  from  .74  to  .95  with  half  of  the  tasks 
in  excess  of  .86)  and  relatively  low  variability  (SDs  range 
from  .07  to  .33).  It  is  conceivable  that  these  kinds,  of 
experienced  troops  may  have  devised  ways  of  performing  their 
tasks  not  strictly  in  accordance  with  SOP.  Such  an  approach 
to  performance  of  the  hands-on  tasks  in  the  SQT  might  have 
been  pursued  by  the  more  experienced  and  "savvy"  gunners. 

However,  because  of  the  strict  attention  to  scoring  of  steps 
and  sequence  of  steps  in  the  SQTs,  their  performance  would 
have  suffered.  Some  support  for  this  notion  comes  from  the 
readiness  retest  data.  We  have  been  advised  that  this  second 
administration  was  scored  much  more  stringently  with  steps 
and  sequences  of  steps  having  to  be  performed  precisely  in 
accordance  with  specified  standards.  As  a consequence  gunner 
performance  dropped  from  a mean  of  .85  on  the  first  administra- 
tion to  a mean  of  .54  steps  passed  on  the  retest. 

Correlations  between  gunner  confidence  estimates  and  the 
independent  variables  are,  unlike  those  for  drivers  and  loaders, 
largely  insignificant.  Gunner  estimates  of  confidence  are 
essentially  unrelated  to  personal  background,  Army  and  job 
background,  or  congruence  variables.  On  the  other  hand, 
frequency  and  recency  of  practice  relate  significantly  to  con- 
fidence estimates  for  a number  of  the  tasks.  Frequency  of 
practice  is  related  to  confidence  estimates  for  Task  4 (r  = .45, 
p < .001),  Task  5 (r  = .36,  p < .01),  Task  7 (r  = .34,  p < .01) 
and  Task  10  (r  = .34,  p < .01).  Recency  of  practice  relates 
to  Task  5 (r  = .36,  p < .01),  Task  8 (r  = .37,  p < .01), 

Task  9 (r  = .35,  p < .01)  and  Task  10  (r  = .38,  p < .01).  The 
finding  that  the  confidence  which  gunners  have  in  their  per- 
formance of  specific  hands-on  tasks  is  related  to  reported 
frequency  and  recency  of  practice  parallels  the  results  for 
drivers  and  loaders. 

For  gunners  the  substitutibility  of  confidence  data  for 
performance  criteria  is  more  problematic  than  for  the  other 
two  crew  positions  examined  thus  far.  The  two  measures  are 
significantly  related  on  only  one  of  the  composite  tasks 
(Task  3,  r = .35,  p < .01)  although  on  two  others  (Tasks  8 and 
10)  substantial  positive  correlations  are  obtained  (p  < .05). 

Tank  Commanders.  Results  of  the  zero-order  validity 
analyses  of  tank  commander  criterion  data  resemble  those 
obtained  for  gunners,  particularly  with  regard  to  the  proportion- 
of-steps-passed  measure.  Out  of  410  possible  correlations 
(10  composite  tasks  and  41  independent  variables)  only  three 
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are  significant.  Tank  commanders  who  report  that  they  like 
their  job  perform  better  when  servicing  the  M85  machinegun 
(Task  2,  r * ,36,  p <.01)  and  maintaining  it  (Task  4,  r - .43, 
p < .001).  The  third  significant  validity  coefficient  reflects 
the  fact  that  participation  in  gunnery  training  programs  spe- 
cifically as  a tank  commander  is  related  to  performing  main  gun 
prepare  to  fire  procedures  (Task  1,  r * .33,  p < .01).  The 
fairly  substantial  amount  of  readiness  retest  data  available 
for  tank  commanders  reflect  the  same  paucity  of  significant 
correlations.  Performance  during  preparation  of  the  range- 
finder is  inversely  related  to  one's  weight  (Task  5,  r *-.46, 
p < .01).  The  more  months  during  the  past  year  that  one  spent 
engaged  in  tank  commander  activities  the  better  was  his  perfor- 
mance during  prepare  to  fire  procedures  (Task  1,  r * .57, 

p < .001) . 

Proficiency  expressed  in  terms  of  the  summary  performance 
measures  covaries  with  liking  one's  job,  months  spent  as  an 
HE,  months  actually  working  as  a tank  commander,  and  whether 
one  has  occupied  this  crew  position  in  training  programs  and 
Table  VIlls.  The  seven  significant  (p  < .01)  correlations  with 
the  HOP  and  Proportion  GO  measures  range  from  r * .31  to 
r = .36.  Correlations  with  SQT  scores  are  in  a few  instances 
significant,  but  involve  rather  small  subsamples  of  tank 
commanders.  For  example,  on  SQT2  the  proportion  of  steps  passed 
on  the  hands-on  tasks  is  related  positively  to  rank  (r  * .86, 
n = 8,  p < .003).  Interestingly,  the  proportion  of  SQT 2 hands- 
on  tasks  on  which  tank  commanders  receive  a GO  is  inversely 
related  to  the  months  one  has  served  as  a tank  commander  and 
one's  participation  in  training  programs  while  occupying  that 
position  (both  rs  * .69,  n = 13,  p < .01).  These  results 
resemble  those  obtained  for  gunners  on  the  same  set  of  hands- 
on  tasks;  the  same  speculation  applies.  The  longer  one  has 
been  a tank  commander  the  more  likely  he  is  to  have  developed 
idiosyncratic  ways  of  performing  many  of  his  tasks. 

Significant  correlations  between  tank  commander  confidence 
estimates  about  performance  on  the  10  readiness  tests  and 
various  independent  variables  are  shown  in  Table  12.  The 
obtained  correlations  resemble  those  reported  for  drivers  and 
loaders  more  than  they  do  those  few  relationships  established 
for  gunners.  Among  the  personal  background  variables,  whether 
one  likes  his  job  is  related  to  confidence  estimates  on  four 
of  the  ten  readiness  tasks.  The  bulk  of  the  significant 
relationships,  however,  involve  Army  and  job  background  as  well 
as  congruence  variables.  Similarly,  strong  relationships 
exist  between  the  confidence  expressed  about  performance  of  a 
given  task  and  the  frequency  and  recency  with  which  that  task 
has  been  practiced.  These  relationships  in  particular  are 
similar  to  those  found  in  the  two  more  junior  crew  positions. 

As  in  the  case  of  the  gunners,  caution  must  be  used  in 
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Table  12.  Zero-Order  Validities*  Between  Background/Oongruence/ 
Practice  Variables  and  Confidence  Estimates  for  Tan  Tank 
Ccmmander  Ccrposite  Tasks 
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Correlations  rounded  to  the  nearest  hundredth  with  decimal  points  omitted. 

Correlations  with  significance  levels  .001  sre  indicated  in  boldface:  others  ire  sionificant  in  the 
ranee  < .01,  s .001. 


considering  the  import  of  these  relationships.  The  connection 
between  confidence  and  performance  is  weak,  a significant 
correlation  being  obtained  on  only  one  task  (Task  2,  r = .39, 
p < .01).  The  lack  of  relationships,  however,  may  be  due  at 
least  partially  to  the  nature  of  the  tank  commander  readiness 
performance  data.  Scores  obtained  in  both  the  first  and 
second  administrations  are  very  high  on  the  average,  and 
exhibit  very  small  variance.  The  lack  of  correlations  with 
these  data,  either  with  respect  to  the  independent  variables 
or  the  confidence  estimates,  must  be  considered  in  this  light. 

Summary . Examination  of  the  zero-order  validities  reveals 
that  variables  describing  experience,  whether  drawn  from  the 
Army  and  job  background  or  the  congruence  categories,  relate 
to  levels  of  task  performance  in  the  more  junior  crew  positions. 
Similar  relationships  are  not  obtained  in  the  two  more  senior 
positions.  An  implication  of  these  findings,  and  one  supported 
by  the  relatively  high  performance  levels  of  gunners  and  tank 
commanders  and  the  proportion  of  both  these  samples  who  were 
occupying  their  normal  crew  positions  and  who  were  experienced 
at  doing  so,  is  that  both  of  these  samples  are  too  homogeneous 
with  respect  to  experience  to  reveal  the  congruence  effects  of 
interest.  The  driver  and  loader  samples  contain  more  "fills" 
and  less  experienced  personnel,  factors  which  should  give  rise 
to  congruence  effects  if  such  truly  exist.  Were  other,  more 
heterogeneous  samples  of  gunners  and  tank  commanders  investi- 
gated, it  is  predicted  that  their  zero-order  validities  would 
more  closely  approximate  the  patterns  associated  with  the 
drivers  and  loaders  sampled  in  the  present  study. 

In  all  cases  except  the  gunner  sample,  job  experience  and 
practice  variables  relate  to  soldiers'  confidence  in  being 
able  to  perform  hands-on  tasks.  Based  on  the  more  junior  crew 
members,  there  is  evidence  that  suggests  the  confidence  esti- 
mates do  in  fact  relate  to  levels  of  proficiency. 

Two-Way  Frequency  Table  Analyses 

In  Phase  I of  the  current  effort  relationships  among 
several  predictor  variables,  considered  simultaneously,  and 
selected  criterion  variables  were  explored  by  means  of  special- 
ized multiple  regression  techniques.  The  results  of  these 
analyses  varied  among  the  four  crew  positions  and  from  task 
to  task  within  each  crew  position.  The  lack  of  more  consistent 
findings  may  in  part  have  been  due  to  the  use  of  these  sophis- 
ticated statistical  procedures  on  the  relatively  small  sample 
sizes  available  for  analysis. 
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In  the  current  phase  of  research  a rather  different 
strategy  was  pursued  in  the  attempt  to  determine  whether 
several  experience  or  congruence  variables  might  relate  to 
performance  and/or  confidence  criterion  measures.  In  essence, 
a case  study  approach  was  used  in  which  all  of  the  background 
information  reported  in  the  Background  Information  Questionnaire 
was  carefully  reviewed  for  each  soldier.  The  question  initially 
addressed  was  whether  a brief  narrative  prepared  for  each  soldier 
might  not  permit  a global  (but  multidimensionally  determined) 
judgment  about  his  job  congruence  or  experience.  For  example, 
subject  #5,  a driver  is: 

"A  22-year  old,  5 '10",  145  lb.,  right-handed 
soldier  with  less  than  a high  school  diploma.  He 
has  been  in  the  service  for  31  months  and  has 
attained  the  rank  of  an  E5.  He  has  been  an  11E20 

for  one  month  and  has  a duty  MOS  of  11E20.  His 

present  job  title  is  that  of  a driver  which  he  has 
held  for  19  months.  He  has  no  secondary  MOS  but  has 
had  down-range  driving  experience,  tank  tables,  and 
classes.  He  has  been  a driver  in  gunnery  programs 
and  has  fired  two  Table  VIIIs  in  that  position.  He 

has  been  in  a tank  crew  from  two  to  three  years  and 

during  the  past  year  has  spent  240  days  doing  driver 
kinds  of  activities  on  an  average  of  four  hours  a 
day.  He  likes  his  job  and  plans  to  reenlist.  He 
will  be  tested  as  a driver." 

As  another  example,  subject  #9,  also  in  the  driver  sample, 
is: 

"A  19-year  old,  5' 7",  150  lb.,  right-handed 
soldier  who  is  a high  school  graduate.  He  has  been 
in  the  service  for  17  1/2  months  and  has  attained 
the  rank  of  an  E3.  He  has  held  primary  and  duty  MOSs 
for  the  past  12  months  of  63C10  and  during  that  time 
has  had  the  job  title  of  track  mechanic.  He  has  no 
secondary  MOS  and  has  had  no  special  gunnery  training 
or  experience  with  Table  VIIIs.  He's  not  been  a 
member  of  a tank  crew.  During  the  past  year  he  has 
spent  0 days  as  a driver.  He  doesn't  like  his  job 
and  won't  reenlist.  Although  he  normally  repairs 
tracks  he  will  participate  in  the  research  as  a 
driver . " 

Based  on  these  two  and  a number  of  similar  cameos  developed 
for  each  crew  position,  the  idea  emerged  of  locating  soldiers 
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along  a number  of  branches  in  a tree-diagram.  The  branches 
were  defined  by  the  following  binary  variables: 

1.  The  soldier  is  or  is  not  being  tested  in 
the  same  position  as  his  job  title; 

2.  He  does  or  does  not  have  an  HE  Primary  MOS; 

3.  He  does  or  does  not  have  an  11E  Duty  MOS; 

4.  He  has  or  has  not  participated  in  special 
gunnery  training  programs; 

5.  He  has  or  has  not  crewed  in  Table  Vlll(s); 

6.  He  has  or  has  not  been  a member  of  a tank 

crew. 

Using  the  branching  strategy  described  above,  it  was 
possible  to  uniquely  classify  each  soldier  in  one  and  only  one 
terminal  node.  And  in  spite  of  the  large  number  of  nodes  theo- 
retically available,  most  soldiers  in  our  samples  fell  into  a 
relatively  small  number  of  categories.  For  example,  it  was 
possible  to  locate  drivers  in  six  basic  categories.  These 
ranged  from  the  most  congruent  or  experienced  drivers  (the  yes, 
yes,  yes,  yes,  yes,  yes  group)  to  the  least  congruent  or 
experienced  group  (the  no,  no,  no,  no,  no,  no  group) . Inciden- 
tally, driver  #5  depicted  above  fell  into  the  former  group, 
while  driver  #9  fell  into  the  latter  category. 

Further  attempts  were  made  to  differentiate  among  soldiers 
within  a particular  congruence  category  based  on  several  experi- 
mental variables.  These  included: 


1.  Months  in  Primary  MOS, 

2.  Duty  Time, 

3.  Hours  per  Day, 

4.  Job  time,  and 

5.  Years  in  a crew. 


Although  this  effort  took  place  in  the  absence  of  information 
about  zero-order  validities  it  is  interesting  to  note  that 
these  variables  related  to  criterion  measures  for  a number  of 
tasks,  and  crew  positions. 

The  results  of  the  categorization  process  are  depicted  by 
crew  position  in  Table  13.  The  categories  are  defined  in  terms 
of  the  binary  and  experiential  variables  described  above.  The 
number  of  soldiers  in  each  sample  that  fall  into  a particular 
category  are  also  indicated.  Category  assignments  were  made 
by  one  judge  and  reviewed  by  a second  judge.  The  few  instances 
in  which  disagreements  arose  were  resolved  jointly.  In  pass- 
ing it  should  be  noted  that  the  levels-of-experience  distinc- 
tions made  in  Table  13  were  position- speci fic  in  terms  of 
absolute  amounts  of  Duty  Time  and  Prime  Time.  As  such  they 
are  post  hoc  descriptions  and  are  not  meant  to  imply  specific 
levels  of  experience  to  be  addressed  in  future  work. 
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In  the  next  stage  of  the  analysis  three  judges  considered 
each  of  the  composite  readiness  tasks  for  each  crew  position 
in  detail.  They  then  ordered  the  categories  of  soldiers  within 
each  sample  so  as  to  conform  to  predicted  levels  of  proficiency 
on  each  task.  Categories  of  soldiers  high  in  the  ordering  were 
predicted  to  be  more  proficient  than  those  lower  in  the  ordered 
groups.  When  distinctions  in  probable  performance  were  not 
judged  to  be  evident,  groups  were  treated  as  ties  and  pooled. 
Predicted  orders  were  developed  independently  for  each  individ- 
ual task.  They  are  presented  in  Table  14. 

Using  these  rankings  and  criterion  performance  and  confi- 
dence data,  two-way  frequency  tables  were  developed  for  each 
task  that  related  the  ordered  categories  to  the  criterion  data. 
One  set  of  such  tables  was  developed  for  the  confidence  esti- 
mate criterion  data  (four  levels);  another  set  was  developed 
for  the  readiness  test  proport ion-of- steps  passed  measure.  For 
purposes  of  examining  these  latter  data  one  performance 
category  was  used  to  represent  perfect  performance  (1.00);  the 
remaining  scores  on  each  task  were  split  into  two  or  three 
categories,  the  attempt  being  made  to  obtain  an  appreciable 
frequency  in  each  category,  and  to  have  roughly  comparable 
frequencies  across  the  performance  categories  representing  less 
than  perfect  (1.00)  performance.  An  example  of  a two-way 
frequency  table .relating  congruence  to  performance  is  presented 
in  Table  15  for  the  driver  task  (Task  #1)  dealing  with  the 
preparation  of  periscopes. 

The  two-way  frequency  tables  were  analyzed  in  terms  of  a 
variety  of  measures  of  predictability,  correlation,  and  asso- 
ciation. BMDP  program  P1F  (1977rwas  used  to  explore  the 
relationship  between  levels  of  congruity  (represented  by  the 
rank-ordered  categories  of  soldiers)  and  levels  of  the  criteria 
(scaled  confidence  and  performance  data) . Three  statistics 
were  evaluated  including  Somer's  D,  the  Spearman  rank-order 
correlation  (p),  and  the  Pearson  \z . Somers'  D provides  the 
best  test  of  the  congruency  hypothesis.  It  ranges  from  1.0 
to  -1.0  and  as  a predictive  measure  represents  the  probability 
of  similar  ranking  on  two  indices  among  cases  with  different 
values  for  the  predictor  index.  Its  significance  (departure 
from  zero)  may  be  evaluated  by  means  of  a t statistic  with 
approximately  .4N  degrees  of  freedom  (Brown  and  Benedetti, 

1977  ).1 2  The  Spearman  p was  used  to  express  the  relationship 
between  the  two  variables  as  a correlation.  \2 , although  not 

1 BMDP  Biomedical  Computer  Programs  P-Series  1977.  Dixon,  W. J . 

& Brown,  M.B.  (Eds),  University  of  California  Press,  1977. 

2 Brown,  M.B.,  & Benedetti,  J.K.  Sampling  behavior  of  tests 

for  correlation  in  two-way  contingency  tables.  J,  Amer. 

Statist.  Assoc.  72,  1977,  309-315. 
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Table  14.  Categories  of  Soldiers  Ordered  in  Terms  of  Predicted  Perfi 
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Table  15.  Two-Way  Frequency  Table 
Relating  Driver  Congruence  and  Performance 

* 

Driver  Categories 

la 
2a 
lb 
10a 

lc,  2b,  4 
5 

6a,  6b 
10b,  10c 


TASK  1 

Levels  of  Performance* 

4 3 2 1 


a particularly  powerful  test  of  the  hypothesis  under  considera- 
tion in  this  research,  was  also  computed.  When  necessary, 
because  of  small  expected  cell  frequencies,  x2  was  recomputed 
on  a table  in  which  adjacent  rows  or  columns  were  collapsed. 
Collapsing  occurred  automatically  and  continued  until  the 
smallest  expected  frequency  reached  or  exceeded  1.0.  The 
results  of  these  analyses  are  described  below  for  each  position. 

Drivers.  A significant  relationship  between  congruence 
and  hands-on  performance,  measured  in  terms  of  the  proportion 
of  steps  passed,  exists  only  for  Task  #1,  the  "preparation  of 
periscopes".  The  rank  ordering  of  the  eight  levels  of  congru- 
ence correlates  significantly  with  performance  (p  = .522, 
df  = 40,  p < .01).  The  correlation  is  in  the  predicted  (one- 
tail)  direction.  Somers'  D is  also  significant  (D  = 404; 
t = 4.158,  df  = 16,  p < .0005),  indicating  that  a significant 
predictive  relationship  exists;  i.e.,  prediction  of  level  of 
performance  from  knowledge  about  congruence.  The  x2  for  the 
collapsed  table  (four  levels  of  congruence)  is  not  significant 
by  conventional  standards.  No  significant  relationships  exist 
for  the  four  remaining  tasks. 

Results  for  the  confidence  data  are  presented  in  Table  16. 
In  each  instance  there  is  evidence  that  the  two  variables  are 
related,  and  more  importantly,  that  congruence  bears  a signifi- 
cant predictive  relationship  to  confidence  estimates.  These 
results,  together  with  those  for  the  performance  data,  parallel 
the  findings  presented  earlier  in  the  zero-order  validity 
analyses. 

Loaders.  Results  for  the  loaders  are  presented  in  Table  17 
for  both  the  performance  and  confidence  criterion  data.  Again 
the  striking  feature  of  these  results  is  how  the  significant 
relationships  on  several  of  the  tasks  mirror  the  zero-order 
validity  findings. 

Performance  is  significantly  related  to  congruence  on  six 
of  the  nine  tasks.  The  exceptions  are  interesting.  In  Task  1 
("check  and  adjust  track  tension")  differentiations  were  made 
among  nine  levels  of  congruence  and  between  two  levels  of  per- 
formance (perfect  and  less  than  perfect) . The  19  loaders 
having  data  were  mapped  onto  this  structure.  Since  13  of  these 
performed  perfectly  (and  another  two  nearly  so) , relatively 
few  cases  were  available  with  which  to  explore  poorer  perfor- 
mance. On  the  other  hand,  perhaps  judges  more  experienced 
with  the  subject  matter  would  not  have  made  such  fine  differen- 
tiations among  loader  categories.  In  any  event,  across  the 
several  different  kinds  of  analyses,  few  correlates  of  per- 
formance on  this  task  have  been  found. 
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•Cable  16.  Two-Way  Frequency  Table  Analyses? 
Driver  Confidence 


Task 

Dimensions* 

D 

1 

8x4 

.522a 

2 

5x4 

.362° 

3 

8x4 

,542a 

4 

8x4 

.463a 

5 

10x4 

.599a 

£_ 

£ 

Collapsed 

Dimensions 

688b 

26.402b 

(4x4) 

313C 

3.403  N.S. 

(3x2) 

688b 

19.438° 

(6x3) 

605b 

23.061° 

(6x3) 

768b 

41.51b 

(6x4) 

♦Levels  of  congruence  by  levels  of  performance. 

a)  p < .0005 

b)  p < .01 

c)  p < .05 
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Table  17.  TVo-Way  Frequency  Table  Analyses 
Loader  Performance 


Task 

Dimensions* 

D 

P_ 

2d 

Collapsed 

Dimensions 

1 

8x2 

.161 

.261 

2.86 

(3x2) 

2 

10x3 

.141 

.203 

11.11 

(5x3) 

3 

3x3 

.196 

.232 

1.06 

(3x2) 

4 

8x4 

.295° 

,372C 

11.22 

(5x3) 

5 

2x3 

.636° 

• 438b 

12.32b 

(2x3) 

6 

10x3 

.474a 

.659b 

36. lla 

(7x3) 

7 

10x3 

• 353b 

.527b 

14.75C 

(7x2) 

8 

11x4 

.275° 

.357° 

14 . 89C 

(4x3) 

9 

11x4 

.425° 

9.83 

(4x3) 

Loader  Confidence 


Task 

Dimensions* 

D 

P. 

2d 

Collapsed 

Dimensions 

1 

8x4 

• 34913 

.472b 

28 . 61b 

(6x3) 

2 

9x4 

.39513 

.528b 

29.33b 

(5x4) 

3 

8x4 

• 552a 

.606b 

19.80a 

(6x3) 

4 

8x4 

• 410a 

,575b 

27.50b 

(6x3) 

5 

2x4 

.859b 

,625b 

20.00a 

(2x4) 

6 

9x4 

• 428a 

.654b 

31.34b 

(8x3) 

7 

9x4 

• 391b 

.529b 

21.73° 

(5x4) 

8 

10x4 

.422a 

.593b 

18.74° 

(5x3) 

9 

10x4 

.19 

.272 

8.80 

(6x3) 

* 

Levels  of  congruence  by  levels  of  criterion. 

a)  p < .0005 

b)  p < .01 

c)  p < .05 
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In  Task  2 ("boresight  the  M219")  performance  is  simply 
not  related  to  levels  of  congruence  as  we  have  defined  it. 
Inspection  of  the  underlying  performance  data  reveals  several 
instances  in  which  the  performance  for  a given  level  of  con- 
gruence is  high,  intermediate  and  low,  independent  of  the  par- 
ticular level  of  congruency  considered.  Finally,  on  Task  3 
("stow  main  gun  rounds")  only  three  levels  of  congruence  were 
established,  groups  of  loaders  being  pooled  to  form  the  three 
strata.  Had  the  third  category  of  loaders  (comprised  of  per- 
sonnel who  presumably  were  "fills"  for  this  crew  position) 
been  combined  with  those  in  the  second  congruence  category,  a 
stronger  relationship  might  have  been  demonstrated.  As  it  was, 
and  contrary  to  our  predictions,  three  of  these  troops  (out  of 
five  for  whom  there  were  data)  performed  the  task  perfectly. 

Expressions  of  loader  confidence  are  strongly  related  to 
levels  of  congruity  on  all  but  one  of  the  tasks.  For  both 
loaders  and  drivers,  therefore,  confidence  clearly  covaries 
with  a relatively  small  set  of  variables  reflecting  one's  on- 
the-job-experience. 

Gunners  and  tank  commanders.  Analyses  of  the  frequency 
tables  developed  for  these  two  more  senior  crew  positions 
reveal  few  relationships  to  be  significant.  In  essence  gunner 
performance  is  not  related  to  judgments  about  congruence.  None 
of  the  ten  analyses  is  significant.  With  respect  to  the  con- 
fidence criterion,  relationships  are  found  on  three  tasks  but 
these  are  only  marginally  significant  (Task  1,  D = .285, 
p < .05;  Task  2,  D = .266,  p < .05;  and  Task  4,  D = .289, 
p < .01).  With  these  exceptions,  relationships  between  con- 
gruence and  gunner  criterion  measures  remain  largely  inscrutable. 

The  same  situation  is  true  for  tank  commander  performance 
data.  Congruence  and  performance  are  related  on  only  one  task 
and  marginally  so  (Task  3,  D = .282,  p < .025).  However,  when 
the  confidence  data  were  examined,  a number  of  relationships 
were  uncovered.  These  are  summarized  in  Table  18. 
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Table  18,  Two-Way  Frequency  Table  Analyses  x 
Tank  Ccnnander  Confidence 


Task 

Dimensions* 

D 

P_ 

id 

Collapsed 

Dimension 

1 

5x4 

• 356b 

. 437b 

11.76 

(4x3) 

2 

5x3 

.020 

.030 

2.79 

(4x2) 

3 

3x4 

• 472b 

.458b 

8.38C 

(2x3) 

4 

3x4 

,314c 

.324° 

4.17 

(2x3) 

5 

6x4 

.406b 

.500b 

16.29C 

(4x3) 

6 

2x4 

** 

** 

kk 

** 

7 

6x4 

.248C 

.310° 

6.47 

(4x3) 

8 

5x4 

.302c 

,364C 

10.99 

(4x3) 

9 

5x4 

.358b 

.446b 

11.47b 

(4x2) 

10 

5x4 

• 376b 

.480b 

15. 06C 

(4x2) 

♦Levels  of  congruence  by  levels  of  confidence. 

♦♦Not  ocnputed;  two  congruence  groups  were  formed  in  one  of  which  n = 1. 

a)  p < .0005 

b)  p < .01 

c)  p < .05 


Summary 


One  of  the  primary  objectives  of  Phase  II  research  was  an 
intensive  investigation  of  the  "congruity  hypothesis".  Toward 
this  end  two  outcomes  were  viewed  as  essential.  First,  it  had 
to  be  determined  whether  any  of  the  myriad  independent  (con- 
gruity) variables  covaried  with  any  of  several  criteria  reflect- 
ing "effectiveness  of  performance  on  combat-related  tasks". 
Second,  it  had  to  be  determined  whether  such  relationships  or 
effects  (if  they  existed)  were  consistent  across  different  tasks, 
whether  considered  within  or  between  crew  positions;  the  latter 
distinction  was  necessitated  by  virtue  of  the  heterogeneous 
sample  of  HE  troops  available  for  study.  To  provide  a fair 
evaluation  of  these  issues  substantial  project  resources  were 
invested  in  cleaning  up  the  underlying  data  base  and  then 
in  analyzing  it  productively. 


In  both  this  and  the  preceding  phase,  investigation  of 
the  first  issue  focused  on  the  demonstration  that  significant 
correlations  (zero-order  validities)  existed  between  the  inde- 
pendent and  dependent  variables.  Such  a demonstration  has  in 
fact  occurred.  Most  if  not  all  of  the  independent  variables 
have  been  found  to  correlate  significantly  with  a dependent 
measure  in  at  least  one  instance.  Several,  particularly  those 
drawn  from  the  Army  and  job  background  and  congruence  categories, 
have  repeatedly  correlated  with  dependent  variables.  This  fact 
has  been  amply  documented  in  the  zero-order  validity  results 
presented  earlier  in  this  section. 


The  rub,  of  course,  is  that  while  such  a demonstration  is 
necessary,  it  is  not  sufficient.  It  must  also  be  demonstrated 
that  the  independent  variables,  or  at  least  some  subset  of 
them,  repeatedly  and  consistently  relate  to  a given  criterion 
measure.  Alternatively,  one  must  be  able  to  account  for  and 
eventually  predict  those  instances  that  prove  to  be  exceptions. 
The  required  demonstration  was  not  provided  in  Phase  I,  either 
in  terms  of  the  zero-order  validities  calculated  for  individual 
variables  or  the  "best  subsets"  of  variables  identified  during 
the  regression  of  multiple  (potential)  predictors.  In  either 
case  the  result  was  the  same:  there  were  a few  independent 
variables  that  repeatedly  relate  to  a given  criterion  measure, 
did  not  do  so  with  the  degree  of  consistency  one  would  like  to 
have  seen. 


The  issue  was  addressed  in  Phase  II  by  attempting  to 
distill  a small  subset  of  the  Army  and  job  background  and  con- 
gruence variables  into  a single  index  that  could  be  used  to 
portray  congruence.  The  possibility  of  relating  this  index 
to  various  criterion  measures  was  then  investigated  by  means 
of  the  two-way  frequency  tables  discussed  above.  With  respect 
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to  the  performance  criterion  measure,  instances  were  found  in 
which  the  congruence  index  related  significantly  to  the 
proportion-of -steps-passed  measure.  The  relationship  varied, 
however,  across  criterion  tasks  and  across  crew  positions. 

An  examination  was  also  conducted  of  the  relationship  between 
the  congruence  index  and  confidence  estimates  about  one's 
ability  to  perform  combat-related  tasks.  While  the  results 
were  somewhat  more  consistent  across  tasks  within  a single 
position,  they  varied  markedly  between  crew  positions.  In 
neither  case,  therefore,  whether  considering  performance  or 
confidence  estimates,  was  the  required  level  of  consistency 
in  results  obtained.  As  a consequence,  an  alternative  strategy 
was  pursued.  As  discussed  in  the  next  section,  attempts  were 
made  to  construct  a taxonomy  of  the  combat- re la ted  tasks  that 
might  give  rise  to  more  consistent  patterns  of  results,  thereby 
permitting  generalizations  about  the  specific  tasks  comprising 
any  position,  job,  or  MOS. 


AN  ALTERNATIVE  TASK  TAXONOMY 


The  function-based  task  grouping  adopted  in  the  previous 
sections  of  this  report  is  only  one  approach  to  analyzing  the 
confidence  and  performance  measures  and  their  relationship  to 
congruence.  A problem  with  this  approach,  however,  is  that  it 
is  by  design  restricted  to  tank  crew  skills;  any  generalization 
of  task  groupings  to  other  MOS  designations  is  impossible. 

This  section  is  concerned  with  the  conceptualization,  develop- 
ment, and  partial  evaluation  of  an  alternative  method  for 
organizing  tasks  that  could  potentially  be  more  valuable  for 
unraveling  the  relationships  of  concern  and  extending  them  to 
other  jobs. 

One  approach  is  to  consider  the  congruency  issues  relative 
to  a taxonomy  that  differentiates  tasks  on  the  basis  of  the 
cognitive  and  information-handling  processes  involved.  Ideally, 
this  approach  would  detect  selective  congruence  effects  that 
vary  according  to  the  cognitive  processes  involved  in  task  per- 
formance. Such  a taxonomy  would  have  the  added  benefits  of 
applicability  to  the  other  military  occupations  and  compati- 
bility with  some  of  the  new  directions  in  selection  and  place- 
ment testing.  This  taxonomy  could  thus  provide  a good  generaliz- 
able  tool  for  analyzing  the  relationship  between  criterion-task 
performance  and  congruity. 

Development  of  the  Taxonomy 

The  hypothesized  influence  of  job  congruity  on  criterion- 
task  performance  stems  from  at  least  two  factors:  (1)  the  amount 
and  kind  of  the  practice  a soldier  receives  on  a criterion  task 
on  the  job,  and  (2)  the  amount  and  nature  of  transfer  from  nor- 
mal duty,  on-the-job  tasks  to  criterion  tasks.  In  the  first 
situation  the  soldier  performs  the  criterion  task  as  a part  of 
his  regular  job  and  the  issue  is  how  often  and  under  what  condi- 
tions the  task  is  performed.  In  the  second  situation  the 
criterion  task  is  not  performed  as  part  of  the  soldier's  regular 
job  and  the  issue  is  how  the  on-the-job  tasks  interfere  with 
or  facilitate  performance  of  the  criterion  tasks.  The  latter 
issue  is  a very  important  one;  however,  it  requires  a task  and 
job  analysis  that  is  much  too  complex  and  task-specific  for 
present  purposes.  The  practice  issue  fits  much  better  into  the 
goals  of  the  preceding  paragraph.  Thus  in  developing  the 
taxonomy  described  below,  the  overriding  concern  in  selection 
of  the  dimensions  was  the  availability  of  information  about 
the  nature  of  changes  in  performance  on  a potential  dimension 
as  a function  of  the  recency  and  frequency  of  practice.  A 
knowledge  of  the  nature  of  these  effects  will  allow  us  to  relate 
the  taxonomy  to  congruity  through  the  practice  issue. 
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The  dimensions  of  the  taxonomy  were  also  made  "independent 
and  orthogonal"  in  the  sense  that  the  operational  definitions 
of  each  dimension  required  distinct  pieces  of  information.  This 
provided  maximum  descriptive  flexibility  since  the  tasks  could 
be  described  by  either  a set  of  values  on  dimensions  or  by  a 
single  dominant  dimension.  Using  these  criteria,  five  dimensions 
were  derived  for  the  present  set  of  tasks.  They  are  presented 
below. 

Procedural  Dimension.  The  procedural  dimension  involves 
those  aspects  of  the  task  that  require  the  operator  to  follow 
a fixed  sequence  of  actions.  For  example,  the  dismounting  and 
disassembly  of  the  machinegun  would  be  heavily  weighted  on  the 
procedural  dimension  since  the  steps  involved  have  to  be  per- 
formed in  a pre-determined  order;  the  soldier  has  little  or  no 
freedom  in  the  order  in  which  the  steps  are  performed.  Because 
the  required  sequence  of  responses  is  fixed,  performance  on  this 
dimension  should  vary  in  much  the  same  way  as  in  the  serial 
learning  tasks  extant  in  the  experimental  literature.  Thus  one 
would  expect  strong  effects  of  practice,  with  task  performance 
increasing  with  both  the  recency  and  the  frequency  of  practice. 
Also,  the  longer  or  more  complex  the  procedural  aspects,  the 
more  influenced  by  the  practice  variables  we  might  expect  task 
performance  to  be. 

Perceptual  Dimension.  The  perceptual  dimension  involves 
the  aspects  of  the  task  in  which  the  operator  is  required  to 
use  perceptual  processing  in  vigilance,  inspection,  detection, 
monitoring,  identification  or  discrimination.  For  example, 
acquiring  targets  or  checking  the  machinegun  mainly  involve 
perceptual  processing  for  detection  of  targets  and  defects, 
respectively.  These  tasks  would  be  heavily  weighted  on  the 
perceptual  dimension.  Performance  on  this  type  of  task  has  also 
been  found  to  be  strongly  affected  by  practice.  As  Welford  states, 

"On  the  perceptual  side,  practice  seems  to  enable 
the  skilled  performer  to  select  from  among  the 
mass  of  data  impinging  on  his  sense  organs  so  that 
he  neglects  much  of  what  is,  to  an  unskilled  person 
striking,  and  reacts  strongly  to  data  that  a normal 
observer  would  fail  to  notice.  Practice  may  also 
enable  him  to  make  absolute  judgments  with  much  ^ 
greater  precision  than  would  otherwise  be  possible. 

It  appears  that  for  this  dimension,  frequency  of  practice  might 
be  more  heavily  weighted  than  the  recency  of  practice. 

Welford,  A.  T.  Fundamentals  of  Skill.  London:  Methuen  & 

Co.,  Ltd.,  1968. 
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Communicative  Dimension.  This  dimension  concerns  those 
aspects  of  a task  that  require  the  operator  to  accurately  re- 
ceive or  transmit  information  for  successful  completion  of  the 
task.  Many  of  the  firing  procedures,  for  example,  require 
communication  among  the  crew  for  successful  performance.  The 
extent  to  which  crew  members  are  familiar  with  the  standard 
procedures  and  language  for  communicating  will  determine  the 
number  of  steps  completed  and  the  speed  with  which  the  steps 
can  be  completed.  This  communication,  because  it  requires  use 
of  a standard,  but  unique  language,  is  strongly  affected  by 
the  practice  variables.  The  ability  to  access  the  necessary 
codes  and  symbols  in  memory  should  increase  with  increasing 
frequency  and  recency  of  practice,  and  thus  performance  of 
tasks  weighted  heavily  on  this  dimension  should  increase  in  a 
similar  manner. 

Feedback  Dimension.  This  dimension  concerns  those  attri- 
butes  of  the  task  that  provide  the  operator  with  information 
about  the  correctness  of  his  response  which  he  can  use  to 
direct  his  behavior  through  completion  of  the  task.  Example 
behaviors  would  include  aligning,  tracking,  and  some  adjusting 
activities.  For  the  present  situation,  performance  on  this 
dimension  should  be  relatively  free  of  practice  effects;  since 
the  task  performance  itself  provides  the  information  which 
directs  behavior,  the  operator’s  ability  to  access  information 
in  memory  should  have  little,  if  any,  effect. 

Motor  Dimension.  The  motor  dimension  involves  those  aspects 
that  require  physical  proficiency  in  a motor  skill  for  success- 
ful task  completion.  An  example  would  be  the  motor  coordina- 
tion required  to  drive  the  tanks.  Such  tasks  should  show  few, 
if  any,  effects  from  the  recency  and  frequency  of  practice, 
since  the  literature  shows  retention  of  motor  skills  to  be  very 
high. 


In  sum,  the  proposed  taxonomy  describes  tasks  in  terms 
of  their  values  on  five  dimensions:  procedural,  perceptual, 
communicative,  feedback,  and  motor.  Performance  on  the  first 
three  of  these  dimensions  should  decrease  as  the  recency  of 
practice  or  the  amount  of  previous  practice  decreases,  while 
performance  on  the  last  two  dimensions  should  be  relatively 
unaffected  by  the  recency  or  amount  of  practice  (given  prior 
competence) . 

Evaluation 


A two-phase  approach  was  used  to  study  the  usefulness  of 
the  taxonomy  as  a tool  for  analysis.  The  first  phase  involved 
determining  that  performance  on  task  groups  derived  from  dimen- 
sions of  the  taxonomy  were  related  to  variables  in  the  predictor 
set.  The  second  phase  involved  demonstrating  that  the  dimensions 
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operated  in  application  as  predicted  in  theory.  Here,  another 
set  of  correlations  relating  specific  experience  and  dimension 
performance  was  inspected  for  specific  patterns  predicted  by 
the  information  available  on  practice  effects  for  that  dimen- 
sion. The  results  of  these  two  analyses  were  used  as  a basis 
for  evaluating  the  taxonomy. 

Prior  to  initiation  of  the  first  analysis,  the  criterion 
tasks  were  analyzed  with  respect  to  the  taxonomic  dimensions. 

This  was  accomplished  by  a consensual  rating  of  the  tasks  by 
three  judges.  After  a consensus  was  reached  as  to  the  dimensions 
present  in  each  task,  the  tasks  were  then  consensual ly  rated 
as  to  the  single  dominant  dimension  in  the  task.  In  some  cases 
it  was  impossible  to  assign  a single  dominant  dimension; 
in  these  cases  two  or  more  dominant  dimensions  were  assigned. 

In  several  other  cases,  a "minor  dominant"  dimension  was  also 
designated.  These  were  cases  where  a secondary  dimension  was 
clearly  judged  to  be  potentially  predictive  of  performance, 
but  did  not  adequately  describe  the  task  if  considered  alone. 

The  results  of  these  assignments  for  each  task  are  presented 
in  Table  19  by  crew  position.  The  table  shows  that,  in  general, 
the  tasks  were  judged  to  be  predominantly  procedural  and  that 
only  the  gunner  and  commander  positions  included  tasks  where 
communication  was  considered  a dominant  dimension. 

Tasks  were  then  combined  according  to  the  dominant  dimen- 
sions. Two  combination  rules  were  used.  The  first  combined 
those  tasks  that  were  rated  major  dominant  and  those  rated 
minor  dominant  on  a particular  dimension.  This  grouping  com- 
bined tasks  on  which  the  dimension (s)  was  considered  as  the 
primary  influence  on  performance.  In  the  second  type  of  com- 
bination, only  the  tasks  that  were  rated  major  dominant  on  a 
particular  dimension  were  combined.  This  grouping  thus  elimi- 
nated the  "minor  dominant"  dimensions  for  each  task.  These 
two  types  of  grouping  were  used  as  the  foundation  for  the 
subsequent  analyses. 

Descriptive  data  for  performance  (proportion  of  steps  GO) 
are  shown  in  Table  20.  As  can  be  seen,  performance  levels  were 
quite  consistent  within  groups,  with  the  exception  of  the  feed- 
back tasks  for  loaders.  These  data  parallel  other  performance 
data  for  the  alternate  task  groupings,  and  unfortunately  do 
not  lead  to  the  generation  of  any  hypotheses  of  differential 
difficulty  of  task  dimensions. 

The  first  phase  of  evaluating  the  taxonomy  involved  looking 
at  the  patterns  of  correlations  between  performance  on  taxonomic 
task  groupings  and  the  background  variables  previously  discussed. 
These  correlations  are  similar  to  the  zero-order  validity 
coefficients  computed  for  the  alternate  task  grouping  adopted 
in  previous  sections  of  this  report.  However,  the  emphasis, 
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Table  19.  Consensual  Rating  of  Drivers'  Tasks  by 
Taxonomic  Dimension 


TAXCNCMIC  DIMENSIONS1 


TUSKS* 

1.  Ram  M27  Periscope 

PBOCEIXJBAL 

EES** 

puoyiuAL 

FEHMACX 

EES 

MOTOR 

JMVSXCXnCN 

2.  Oiecfcs/Sarvicaa  rn  Perisoopee 

EES** 

3.  Install  M2 4 Periscope 

EES** 

4.  Place  M24  Perisoopa 

Into  Operation 

EES** 

EES* 

5.  Checks/ Services  Cn 

Gas  Particulate  Unit 

EES* 

EES** 

6.  Start  Tank  Engine 

EES** 

7.  Checks/ sarvicaa  Cn  Tank  Engine 

And  Oil  Tranani.tsion  Levels 

EES** 

3.  Place  Tank  In  Nxicn 

EES** 

EES 

EES 

EES 

9.  Check  Track  Tension 

EES 

EES** 

EES 

10.  Prepare- to-Fira  Procedures 

EES** 

EES 

11.  Operate  Tank  In  Neutral  Steer 

EES 

EES** 

12.  Cross  vertical  Obstacle 

EES** 

EES** 

EES 

13.  Cross  A Ditch 

EES** 

EES** 

YES 

14.  Ascend  A Steap  Grade 

EES 

EES 

EES** 

YES** 

15.  Descend  A Steap  Grade 

EES* 

EES 

EES** 

EES** 

16.  Drive  Over  A Water  Obstacle 

EES* 

YES* 

YES** 

YES** 

17.  Evasive  .'lanauvar — 

Following  Contends 

EES** 

EES** 

YES 

18.  Evasive  Maneuver — 

Own  Initiative 

EES** 

EES* 

EES* 

19.  Drive  Into  Defilade  Position 

EES* 

YES* 

YES** 

20.  Drive  In  Response  to 

Flra  Cannard 

EES* 

EES** 

YES** 

YES 

21.  Drive  TO  A Halt 

EES* 

EES** 

YES** 

YES 

22.  lock  Brakes  During 

Stationary  Engagement 

EES** 

23.  Acquire  Tirgets 

EES* 

YES 

“"YES  naans  that  dimension  was  Judged  to  ba  peasant  in  tha  task:  ***ne'ior  daninant  dimsnsion  far  task;  •'etmor  icrunant 
dimension  for  task. 

2task  titles  are  abbreviated  for  convenience;  full  titles  era  included  in  fable  1. 
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Table  19.  Consensual  Rating  of  Loaders'  Tasks  by 
Taxonomic  Dimension  (cont'd.) 


TAXCNCMIC  DIMUSICNS1 


TASKS" 

PROCEDURAL 

PERCEPTUAL 

1.  Before-Cperationa  Check  on 

Ehqine  And  Tranamisaion  Oil 

YES 

YES** 

2.  Check  Track  Tension 

YES** 

3.  Adjust  Track  Tension 

YES** 

4.  Check  Operation  Of 

M3  Heater 

YES** 

YES 

S.  Prepare  Tank  For  Boreeighting 

YES** 

6.  Check  Bo resight  Alignment 

Of  Main  Gun 

NTS** 

7.  Boresiqht  M219  Machinequn 

YES** 

S.  Stow  Main  Gun  founds  In  Tank 

YES 

9.  Perform  Main  Gun 

Prepare- to-Fire 

NTS** 

YES 

LOA.  Uiad  Main  Gun— 

Sabot  Loaded 

YES** 

LOB.  Load  Main  Gun — 

.Main  Gun  Mot  Loeiad 

YES** 

10C.  Load  Main  Gun — 

Sabot  Loaded  But  Other  Aimu.  Required 

YES** 

11.  Beady  Coax  In  Response 

Tto  Fire  Ocmremd 

YES** 

12.  Rotate  found  In 

Main  (kn  Misfire 

YES 

13.  Unload  Misfired 

Main  Gun  found 

YES** 

14.  Action  TNd  Reduce  Stoppage 

Of  M219  Mectunagun 

NTS** 

15.  Unload  M219  Machinequn 

YES** 

16.  Remove  M2 19  Machinequn 

Fran  Tank 

YES** 

17.  Disaseeitxle  M219 

Machinequn 

YES** 

18.  Inspect  Machinequn 

NTS** 

FEEDBAOC 


YES* 


YES 


YES 


19.  Aeeifcile  Machinequn 


YES** 


M0IT*  OCmJNICWIGN 

YES 

YES 


NTS** 

NTS 

NTS 

YES 

YES* 

NTS 

NTS* 

NTS 

NTS 

YES** 

YES 

YTS 

20.  Check  operation  YES 

(X  MKhinegun 

21.  .'tMit  Mctunnun  YES** 

•*  he* 

12  UMi  YES** 


YES** 

YES** 

YES** 


NTS**  YES** 

NTS 


NTS 


NTS 


NTS**  NTS  YES 

be  irRMt  in  the  task;  ••’eaajor  dominant  liman* ion  for  tasks  *^uvr  dominant 
<wiavai  Till  titlee  are  includal  in  Table  l. 
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Table  19.  Consensual  Rating  of  Gunners' 
Tasks  by  Taxonomic  Dimension  (oont'd.) 


3WOCMIC  DIMENSIONS1 


TASKS2 

PROCEDURAL 

PERCS’TUAI. 

fueback 

MOTOR 

COMJNICKrcCN 

I.  Ohack  Oparaticn  Of 

M3  Haatar 

YES** 

YES 

I.  CJiarga  Mutual  Elavation  Syataa 

YES** 

YES 

3.  Placa  TUrrat  In 

Power  Operation 

YES** 

YES* 

YES 

4.  Piapara-TO-rire 

Procedure 

YES 

YES** 

5.  Prepara  Tank 

For  Dnraeight 

YES** 

6.  Prapara  Ounnar's  Teieacope 

For  Operation 

YES* 

YES** 

YES 

7.  Prapara  dinner's  Talaecopa — 
Daylight 

YES* 

YES** 

YES 

8.  Prapara  Aaunuth 

Indicator 

YES** 

YES* 

YES 

YES 

9.  Oparata  Elevation 

Quadrant 

YES 

YES** 

YES 

10.  Soraaight  Ounnar's 

TOlaacopa 

YES** 

YES 

YES 

11.  Soraaight  Daylight 

Sight  Of  Periscope 

YES** 

YES 

YES 

YES 

10.  Soraaight  IR  Sight 

Of  Periscope 

YES** 

YES* 

YES 

YES 

13.  Soraaight  Tank 

Saarch  Light 

YES** 

YES* 

YES 

YES 

14.  soraaight  Machineiyin 

YES** 

YES 

YES 

IS.  Taro  Tank  Main  Jun 

YES** 

YES 

YES* 

YES* 

16.  Taro  Maciunagun 

YES** 

YES 

YES* 

YES* 

17.  Main  Sun  Owagamant, 

Stationary 

YES** 

YES* 

YES* 

YES 

18.  Main  Oun  Ehqacrmnt, 

Moving 

YES* 

YES** 

YES** 

YES 

19.  ooax  Sogagamant 

YES* 

YES** 

YES** 

YES 

30.  Main  Oun  Bigaqerant,  Moving  TO  A 
Halt,  Stationary  Target. 

YES** 

YES* 

Y2S* 

YES 

31.  Action  Oi  Main  Oun. 

Failura  TO  Fir  a 

YES** 

YES* 

33.  Onload  Misfirad 

Main  Oun 

YES** 

YES 

33.  Aoquira  Targata 

YES** 

YES 

Kts  mi  that  iimanaion  «m  -udqed  to  b»  praaant  ui  tha  uik:  ••^raior  Jcmnant  Jinanaion  (or  taak:  ♦'minor 
ioninant  iunanaiun  for  taak  1M  c«t) . 

TjiIi  titlaa  u»  ibtoraviatad  for  convamance:  full  titlaa  are  includad  in  Tabla  L. 
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Table  19.  Consensual  Rating  of  Tank  CCrnnanders' 
Tasks  by  Taxonomic  Dimension  (cant'd.) 


TAXOOdC  DOTDEKNS1 


TASKS* 

paxmiwu. 

PER3TTUAL 

FQDBACX 

MOTOR 

COtUNICATICN 

1.  Check  lu 

Particulate  Unit 

YES** 

YES 

2.  Prepare  TP  Fire 

YES** 

YES 

YES 

3.  Load  And  Clear 

Machinegun 

YES** 

YES 

YES 

YES 

4.  Discounting 

Machinegun 

YES** 

5.  Disassemble 
>tachinegun 

YES** 

6.  Maintain 

Msehinequn 

YES** 

YES 

7.  Prepare 

Machinegun 

YES** 

3.  Assemble 

Machinegun 

YES** 

9.  .Mounting 

YES** 

Machinegun 


10.  Prepare  Tank  For  YES** 

Boreeighting 


11.  Prepare  Rangefinder 

For  Operation 

YES** 

YES 

YES 

12.  Determined  Range 
lb  Target 

YES** 

its 

13.  Boresight  Rangefinder 

With  Main  Cun 

YES** 

YES* 

YES 

YES 

14.  Boresight  Tank 

Searchlight 

YES** 

YES* 

YES 

15.  Boresight  M85 

Machinegun 

YES** 

YES* 

YES 

16.  Zero  Main  Gun 

YES** 

17.  zero  M219 

Machinegun 

YES** 

YES 

18.  Zero  M85 

Machinegun 

YES** 

YES* 

\lS 

YES 

19.  Acquire  Targets 

YES** 

YES 

20.  Main  Gun  Engagarent— 

T.C.  Fixes,  Moving,  Stationary 

YES** 

YES* 

YES* 

YES 

21.  Main  Gun  tngagwent— 

Gunner  Fires,  Stationary,  Stationary 

YES 

YES** 

22.  Main  Gun  Engagement— 

Gunner  Fires,  Moving,  Moving 

YES 

YES** 

23.  coaxial  Machinegun  Engagement — 

T.C.  Fires,  Moving,  Jtoving 

YES* 

YES** 

YES** 

YES** 

24.  Coaxial  Machinegun  Engagement— 

Gunner  Fires,  Moving,  Stationary 

YES 

YES** 

25.  Caliber  .50  Engagement— 

T.C.  Flree,  Movinq,  Moving 

YES* 

YES** 

YES** 

YES 

26.  Main  Gin  Engagement— 

Gmner  Fires,  Moving,  Stationary 

YES 

YES** 

Sis  means  that  dimension  was  judged  to  be 
dimension  for  task. 

present 

in  the  task:  **«major  dominant  dimension 

for  task;  Snimr 

KTunant 

“Task  titles  are  abreviated  for  convenience:  full 

titles  ire  included 

in  Table  1. 
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Table  20.  Descriptive  Data:  Performance  for  Taxonomic  Groups 

Driver  Loader  Gunner  Tank  Ccrmander 

N * 45  N ~ 40  N 0 49  N = 45 


X 

SD 

X 

SD 

X 

SD 

X 

SD 

Procedural -Major 

.82 

.22 

— 

— 

.84 

.17 

— 

— 

Procedural  -A1 1 

.81 

.19 

.76 

.30 

.84 

.17 

.94 

.09 

Perceptual -tojor 

.85 

.20 

— 

— 

.88 

.13 

.97 

.07 

Perceptual-All 

.86 

.16 

.78 

.32 

.86 

.14 

.96 

.07 

Feedback-Major 

.91 

.10 

.58 

.50 

.93 

.12 

.96 

.07 

Feedback-All 

.89 

.12 

.63 

.44 

.92 

.09 

.97 

.06 

Nto  tor -Major 

.89 

.12 

.70 

.34 

.96 

.08 

.96 

.07 

Motor-All 

.90 

.12 

.75 

.33 

.93 

.08 

.97 

.06 

Ccrmunication-Maj  or 

— 

— 

— 

— 

.94 

.11 

.96 

.06 

Ccrmunication-All 

— 

— 

_ 

.98 

.14 

— 
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"All"  cure  all  tasks  with  the  dimension  judged  as  irajor  or  minor  dominant 


here  is  slightly  different  in  that  we  were  hoping  to  find 
different  patterns  of  correlations  for  different  taxonomic 
dimensions.  This  would  demonstrate  that  the  dimensions  were  in 
fact  differentially  predictable,  and  would  add  evidence  for  the 
construct  validity  of  the  taxonomy. 

The  correlations  of  performance  on  the  task  groupings  ana 
the  background  variables  are  shown  by  position  in  Table  21. 
Inspection  of  the  table  shows  that  grouping  the  tasks  by  domi- 
nant taxonomic  dimension  did  indeed  produce  different  patterns 
of  correlations  for  different  dimensions.  The  pattern  of  sig- 
nificant correlations  differed  from  position  to  position,  as 
one  would  expect  since  the  specific  tasks  involved  were  different. 
Nevertheless,  the  background  variables  involved  in  the  signifi- 
cant correlations  were  surprisingly  similar,  even  across  posi- 
tions. With  the  exception  of  the  gunners,  variables  involving 
task  experience  or  practice  (e.g.,  job  time,  duty  time,  Table 
VIII  experience  in  position)  tended  to  be  involved  in  the  sig- 
nificant correlations.  Thus,  the  results  of  this  first  analysis 
show  that  the  taxonomic  dimensions  operated  as  different 
dimensions  in  this  application  and  that  these  dimensions  tended 
to  relate  strongly  to  the  experience  and  practice  variables  in- 
cluded in  the  predictor  set. 

The  next  analysis  was  designed  to  investigate  the  extent 
to  which  specific  predictions  about  the  effect  of  experience  on 
performance  in  the  task  groupings  were  supported.  For  this 
phase,  we  returned  to  the  congruence  groupings  of  soldiers  dis- 
cussed previously  (see  Table  13).  As  has  been  stated,  these 
divisions  between  groups  of  subjects  were  based  on  the  amount 
of  past  and  present  experience  at  the  job.  In  essence  the 
groups  represent  different  levels  of  potential  for  practice. 

The  second  phase  of  the  evaluation  took  advantage  of  this  vari- 
ation in  the  soldier  grouping  to  examine  predictions  about  the 
taxonomic  dimensions.  The  groups  in  each  crew  position  were 
assigned  ranks  in  the  order  in  which  they  occur  in  the  table. 

That  is,  the  most  experienced  soldiers  were  given  the  highest 
rank  and  the  least  experienced  were  given  the  lowest  rank. 
Correlation?  were  computed  between  this  variable  and  performance 
scores  (proportion  of  steps  GO)  for  each  taxonomic  category. 

These  correlations  are  shown  in  Table  22.  However,  since 
correlations  by  themselves  represent  only  a summary  index  of 
relationship,  an  additional  step  was  undertaken:  scatterplots 
of  taxonomic  category  performance  as  a function  of  each  con- 
gruence group  were  constructed.  This  produced  a situation  in 
which  performance  on  each  dimension  could  be  visually  evaluated 
over  varying  levels  of  practice.  In  this  manner,  the  predic- 
tions about  practice  effects  discussed  earlier  could  be  eval- 
uated for  each  dimension. 


80 


Table  21:  Correlations  for  Taxonomic  Grouping  and  Background  Variables 

for  Drivers 


TASK  GROUPINGS 


Weight 

Height 

3 i Aqe 

$ ~ Education 

i jj  Like  Job 

FteenList 

Months  Served 
Rank 

3 ^ Months  in  Primary  MDS 

* 2 Skill  Level-Primary  MDS 

Years  in  Crew 

^ “ Jtartber  Positions  Held  in  Training 
Nunber  table  VTIIs 

Months  in  Duty  MDS 
Skill  Level-Duty  MOS 
Test  Position-Job  Title  Match 

2 Position  training 

Position  table  VTIIs 
J Months  in  Position  Past  Year 

Hours  Per  Day  in  Position 
Platoon  Sergeant  Ratings 

Significance  levels  are  indicated  as  follows: 


!!  1 


.15*  .28*  .29*  .14* 


.10* 

** 

.17 

*•* 

.44 

.30* 

** 

.42 

... 

.44 

— 

.27* 

.12* 

** 

.40 

.33* 

.29* 

.26* 

.31* 

— 

! 

.11* 

.27* 

— 

— 

.29* 

.32* 

.27* 

.33* 

— 

.29* 

— 

— 

— 

— 

— 

— 

.27* 

.26* 







— 

— 

.25* 

**• 

.44 

** 

.42  , 

.23* 

.31* 

.12* 

— 

— 



.42 

.40 

.27* 

.28* 

** 

.15 

_ 

— 

.27* 

** 

.39 

** 

.38 

.25* 

— 

** 

.36 

.30* 

.32* 

** 

.35 

.30* 

— 

— 

— 

— 

— 

— 

* p < .05 

**  p < .01 
***  p < .001 

Pearson  produot-ncment  correlations,  rounded  to  the  nearest  hundredth. 
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Paarscn  product-ncmrt  correlations,  rounded  to  the  nearest  hundredth. 


Table  21.  Correlations A for  Taxonomic  Grouping  and  Background  Variables  for 


e 21.  Correlations  for  Taxoncmic  Grouping  and  Backgnc 
Variables  for  Gcmranders  (Excluding  Officers)  (cont'd.) 


Table  22.  Correlations^  Between  Taxonomic  Group  Performance 
and  Congruence  Categories 


Driver 
n = 45 

Loader 
n » 33 

Gunner 
n «=  49 

Tank  O 
n ~ 43 

Procedural -Maj or 

46 

— 

-05 

— 

Procedural-All 

45 

29 

-02 

10 

Perceptual -Maj or 

24 

34 

13 

Perceptual-All 

22 

10 

17 

08 

Feedback-Major 

32 

45 

00 

27 

Feedback-All 

45 

44 

06 

24 

Motor-tojor 

30 

39 

21 

27 

Motor-All 

29 

40 

14 

23 

Ccrrmunication-Maj  or 

— 

— 

-10 

16 

Ccmnunication-All 

_ 

08 

— 

Pearson  product-mcment  correlations,  rounded  to  nearest  hundredth;  decimals 
emitted.  Correlations  with  significant  levels  <_  .01  are  indicated  in  bold 
face. 
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Considering  only  the  correlations,  one  finds  that  only 
the  driver  and  loader  data  produced  meaningful  results.  The 
tank  commander  performance  data  did  not  have  enough  variance 
to  allow  meaningful  comparisons;  performance  at  all  taxonomic 
groupings  over  all  levels  of  experience  was  clustered  around 
perfect  performance,  thereby  precluding  significant  correlations. 
For  gunners,  performance  again  did  not  appear  to  vary  with 
experience.  Only  in  the  driver  and  loader  data  were  the  corre- 
lations significant,  and  thus  consideration  of  the  predicted 
practice  effects  is  limited  to  these  groups. 

The  plot  for  the  drivers ' procedural  tasks  matched  pre- 
dictions in  that  mean  performance  decreased  and  within-level 
variances  increased  with  decreasing  experience.  The  perceptual 
tasks  showed  a similar  increase  in  within-level  variance  with 
decreasing  experience  but  here  mean  performance  was  a U-shaped 
function  over  experience.  Closer  investigation  showed  that  the 
U-shaped  function  stemmed  from  three  groups  of  mechanics  who 
were  difficult  to  evaluate  with  respect  to  experience.  If 
these  groups  were  dropped  performance  would  be  as  predicted. 

Plots  for  the  drivers ' feedback  tasks  showed  that  performance 
decreased  slightly  with  decreasing  experience  and  that  within- 
level  variance  increased  slightly  with  decreasing  experience. 
Finally,  the  motor  tasks  showed  almost  constant  mean  perfor- 
mance and  within-level  variance  across  experience.  This  is 
exactly  as  predicted.  In  sum,  the  driver  data  showed  clear 
support  for  the  predicted  practice  effects. 

I • 

The  loader  data  were  not  quite  as  clear  in  support  of  the 
predictions.  Mean  performance  on  the  procedural  tasks  was 
fairly  constant  across  decreasing  experience,  with  a relatively 
large  within-level  variance  for  some  ranks  and  zero  variance 
(one  score)  for  other  ranks.  The  perceptual  tasks  were  much 
the  same  as  the  procedural  tasks.  The  feedback  tasks  tended 
to  produce  "all-or-none"  performance.  In  the  high  experience 
groups  almost  all  subjects  performed  perfectly  and  in  the  low 
experience  groups  almost  all  subjects  failed  completely.  The 
motor  tasks  showed  large  variances  and  tended  to  have  fairly 
constant  or  slightly  decreasing  mean  performance  across  ranks. 

In  sum,  the  loader  data  clearly  support  the  predictions  only 
in  the  case  of  the  motor  tasks.  For  the  taxonomic  groupings, 
correspondence  between  predicted  and  observed  performance  is 
questionable  at  best. 

Unfortunately,  in  neither  the  loader  nor  driver  data  is 
the  analysis  as  strong  as  one  would  like.  Both  sets  of  data 
contain  groups  that  were  difficult  to  evaluate  with  respect 
to  experience  and  groups  that  often  contained  only  one  or  two 
persons.  It  is  impossible  to  tell  whether  the  failure  to  find 
predicted  results  is  due  to  problems  with  the  taxonomy  or  with 
the  set  of  ranks. 
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Considering  now  the  results  of  the  two-phase  evaluations 
of  the  taxonomy,  we  can  conclude  Cl)  that  the  dimensions  of 
the  taxonomy  appear  to  be  separate  entities  that  differ  from 
one  another  both  in  theory  and  in  application,  and  (2)  that 
with  respect  to  predicted  practice  effects,  there  is  evidence 
to  suggest  that  the  dimensions  might  operate  as  predicted  but 
the  tests  are  not  conclusive.  We  are  left  with  the  conclusion 
that  the  taxonomy  appears  promising;  there  were  enough  interest- 
ing relationships  to  perhaps  warrant  further  exploration  of 
this  approach.  However,  in  this  specific  situation,  the 
taxonomy  did  not  provide  the  degree  of  organization  (i.e.  con- 
sistency) hoped  for.  As  discussed  below,  this  outcome  might 
not  be  solely  due  to  deficiencies  in  the  taxonomy,  but  also  to 
the  problems  inherent  in  the  subject  population  and  performance 
tests  used  in  this  study. 
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DISCUSSION  AND  CONCLUSIONS 


Conceptually,  the  fundamental  question  addressed  by  this 
research  effort  is  a simple  one:  are  there  demonstrable  differ- 
ences in  combat  effectiveness  between  soldiers  whose  normal, 
day-to-day  activities  are  similar  to  their  projected  combat 
roles  and  those  whose  daily  activities  are  not?  However,  a 
realistic  restatement  of  this  question  makes  it  apparent  that 
it  is  not  as  simple  as  it  first  appears:  combat  effectiveness 
depends  upon  many  job-related  factors.  What  are  these  factors, 
how  are  they  related  to  each  other,  and  how  are  they  related 
to  combat  effectiveness? 

/ 

A significant  proportion  of  project  activities  was  devoted 
to  the  translation  of  this  proposition  into  a set  of  meaningful 
empirical  hypotheses.  In  the  course  of  this  translation, 
numerous  subsidiary  issues  arose  that  had  to  be  resolved  before 
more  central  questions  could  be  addressed.  Some  of  these  sub- 
sidiary issues  were  resolved  by  fiat;  others,  due  to  limitations 
of  time  and  resources,  were  resolved  by  "expert  judgment";  and 
others  were  resolved  empirically.  A brief  review  of  project 
activities  will  help  to  put  these  issues  into  perspective;  it 
will  also  serve  to  summarize  the  major  findings.  We  will  then 
return  to  the  central  questions,  presenting  our  "answers"  and 
the  implications  of  these  answers  for  Army  decision-makers. 

Phase  I.  To  reiterate  what  was  discussed  in  the  synopsis, 
the  activities  of  this  phase  consisted  basically  of  selecting 
the  HE  MOS  for  examination  and  identifying  a subject  group, 
collecting  a variety  of  information  concerning  their  experience, 
confidence,  and  performance,  and  conducting  several  analyses 
designed  to  examine  the  relationships  in  the  data.  The  key 
aspects  of  this  phase  relating  to  the  central  questions  of  the 
project  were  the  delineation  of  the  set  of  potential  performance 
predictors,  the  decisions  regarding  the  measurement  of  criterion 
performance,  and  the  decisions  regarding  the  analytical  metho- 
dology used  to  determine  the  relationships  between  predictor 
and  criterion  variables.  It  was  apparent  that  there  was  no 
simple  way  to  characterize  and  organize  all  the  potential 
influences  on  a particular  soldier's  combat  readiness  at  any 
particular  point  in  time,  nor  could  one  easily  delineate  those 
aspects  of  a soldier's  previous  experience  and  day-to-day 
activities  most  important  for  prediction.  Thus,  rather  than 
restricting  ourselves  to  a narrow  and  possibly  infertile  set 
of  predictors,  it  was  decided  to  collect  a broad  range  of 
information  concerning  a soldier's  personal  background,  his 
Army  and  job  history,  and  his  particular  job  experiences. 

Later  analyses  would  be  conducted  to  consolidate  these  variables 
into  a parsimonious  set.  The  same  approach  was  taken  for 
criterion  performance  variables:  A large  initial  set  of  data 


was  collected,  with  the  plan  being  to  later  reduce  the  set  to 
a meaningful  (and  manageable)  performance  index.  The  analyti- 
cal and  statistical  techniques  employed,  while  perhaps  unnec- 
cessarily  complex,  enabled  us  to  provisionally  answer  some  of 
the  central  questions.  Thus,  it  was  found  that  level  of  per- 
formance was  predictable  for  most  soldiers,  and  that  the  hypothe- 
sized "congruence"  variables  were  important  predictors.  However, 
the  results  also  showed  that  different  variables  predicted  per- 
formance for  different  crew  positions  and  for  different  tasks 
within  a given  position.  The  attempt  to  unravel  the  complexities 
of  these  findings  was  the  major  focus  of  the  second  phase  of 
the  project. 

Phase  II.  In  essence,  the  activities  of  this  phase  con- 
sisted of  consolidating  the  predictor  and  criterion  variable 
sets,  and  conducting  several  types  of  analyses  that  attempted 
to  clarify  the  relationships  found  between  congruence  and  per- 
formance. As  discussed  in  various  sections  of  this  report, 
the  first  of  these  activities  produced  several  "byproducts" : 

1.  The  analyses  of  the  interrelationships  among 
the  various  criterion  performance  measures; 

2.  The  analysis  and  ultimate  incorporation  of 
confidence  ratings  into  the  assessment  of 
performance; 

3.  The  development  of  two  distinct  organizational 
taxonomies  for  the  performance  tasks;  and 

4.  The  development  of  what  is  essentially  a 
"congruence  scale" — a method  by  which  soldiers 
could  be  located  and  ordered  along  a single 
multidimensional  scale. 

The  predominant  "central"  results  are  summarized  at  the  end  of 
the  Congruence  Effects  section;  hence,  the  following  discussion 
will  be  of  a more  general  nature,  reflecting  our  current 
"position"  on  the  congruence-performance  issue. 

The  conclusion  we  are  forced  to  draw  from  this  study  is 
essentially  negative;  we  were  unable  to  discover  any  systematic, 
generalizable  connection  between  congruence  and  performance. 

We  suspect  that  this  is  a function  of  two  conditions  that 
severely  limited  even  the  possibility  of  uncovering  significant 
relationships.  First,  there  were  simply  not  enough  "incongruous" 
soldiers  in  our  sample.  Especially  for  gunners  and  tank 
commanders,  crew  positions  for  the  performance  tests  were  over- 
whelmingly filled  by  "appropriate"  soldiers.  It  was  not  the 
case,  as  was  anticipated  in  the  early  stages  of  this  project, 
that  soldiers  were  engaged  in  widely  disparate  day-to-day 
activities.  At  least  for  the  HE  MOS  at  Fort  Carson  during 
the  time  frame  of  this  study,  most  soldiers  were  performing 
combat-related  activities  as  part  of  their  normal  routine  jobs. 
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Unfortunately,  we  do  not  know  whether  this  phenomenon  is  typical 
of  other  MOS's  or  unique  to  this  sample.  Second,  there  was 
simply  not  sufficient  variance  in  performance  to  permit  reliable 
correlations  with  the  predictor  variables.  Again,  we  do  not 
know  if  such  high  performance  levels  are  idiosyncratic  for  the 
particular  group  of  soldiers  in  this  study,  nor  can  we  deter- 
mine whether  it  was  due  to  the  new  performance  test  used.  We 
would  caution  against  assuming  that  the  first  alternative  is 
true — that  performance  levels  could  be  expected  to  be  uniformly 
high  throughout  the  Army.  Nor  are  we  willing  to  assume  that 
the  performance  tests  used  here  were  inadequate  samples  of  com- 
bat effectiveness.  For  future  research  concerned  with  this 
issue,  it  is  possible  that  the  implementation  of  the  EPMS  system, 
including  wide  scale  utilization  of  SQT's,  Soldier's  Manuals, 
etc. , could  ameliorate  the  difficulties  experienced  in  this 
effort. 

On  the  other  hand,  a "positive"  conclusion  to  be  drawn 
from  this  study  is  that  it  seems  possible  to  predict  some 
soldier's  combat  effectiveness  on  a task-by-task  basis,  given 
a relatively  small  amount  of  information  about  the  soldier's 
specific  experience  on  the  task.  Furthermore,  the  soldier's 
confidence  in  his  own  ability  might  be  an  adequate  surrogate 
for  performance,  and  does  not  require  the  substantial  invest- 
ment of  resources  necessary  to  physically  test  his  performance. 


90 


i 

J 


...  ..  • 


. .. 


